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FOREWORD 

The three papers that comprise this report were prepared under 
Kxploratory Development Task Area PF55. 522.002 (flethodology for Developing/ 
Hvaluating Navy Training Fro|trams) • The papers were presented by personnel 
from the Navy Personnel Research and Development 'Center at the Triservice 
^ s Conference on Reading and Readability Research in the Armed Services held in 

October 1975. The Commanding Officer and Technical Director of NAVPERSRA^JDCEN 
were represented at that conference by Dr. Edwin G. Aiken. 

Appreciation is expressed to Dr. Marshall J. Farr of the Office of Naval 
Research, who acted as technical monitor for the conference and its pro- 
ceedings, and to' the staff of the Western Division of the Human Resources 
' ^ Research Organization, who conducted the conference. 



J. J. CLARKIN 
Commanding Officer 




^ - SUMMARY ' 

In October 1975, a triservlce conference on Reading and Readability \ 
Research In the Armed Services was held at the Naval Postgraduate School In 
Monterey, California. The N^vy was represented by the Navy Personnel 
Research and Development Cen&er (NAVPERSRANDCEN) and the Naval Air Systems 
Command;. the Air Force by the Human Resources Laboratory; and the Army by 
the; Army Research Institute fb^jthe Behavioral and Social Sciences, ifie 
Personnel and Training Research Programs Division ofythe Office of Naval * 
Research acted on behaJLf of the three Services In contracting with the ^ 
Human Resources Research Organization to conduct the conference. 

Personnel from NAVPERSRANDCEN made three presentations at the conference 
The first provided an historical perspective on literacy training in the 
Navy. The second presented an overview of current research on/literacy 
In the Navy, with pa/ticular emphasis on recent work at the Center. The 
last addressed ^the area of readability and comprehenslbllity research in, 
the rJavy. , / ' \ 

These papers are forwarded^by this report since if is felt that. the \ 
papers are of sufficiently wide Interest in the' Naval Service to justify* ^ 
extracting' them from the overall Conference Proceedings for separate dis- 
tribution. 

■ •• - • - ' ^ 
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INTRODUCTION 



Problem 



* . 

The success pf Navy education and training ^programs rests not only on 
assuring a system,atlc approach to Instructional design and dellvezy, but also . 
on Improving the match between the entering skills of the students and the > 
requirements- of their ' Curricula/" Language skills-, notably reading,, are among 
''the most fundamental prereqii4.3Zte skills, covering virtually every course 6f 
/lavy Instructlpn and most Navy Jobs. Closely related to reading skills Is 
the readability of the materials dealt with In class and 3t work. Problems « 
relatflng to both reading skills and readability have been documented many 
times over a wide span of years. There Is a need to obtain both an^ historical 
perspective *on Navy literacy problems and a contemporary lo0k at Navy research 
and development In the area. The pr'&sent report, .provldeiB ampule data and 
theory on all the principal Issues. ^ 



BackKrounU ' ^ ^ _ ' , 

,Thls report derives from a trlservlce conference held In* October 1975 
at Monterey, California. The three ^papers Included In this report make up 
the contribution of NAVPERSRANDCEN personnel to that conference. Papers 
f rom *the other services, plus remarks by consultants., can be found In the 
overallT proceedings ^f the conference.^ 

The CenFfer participants divided the area into an historical perspective 
on literacy training in the Navy» literacy research in *the Navy, and read- 
ability research in the Nav^ ^ ef^pxt was ^de to Include* consldetatlon 
of long-standing and current prolaf^ls, 'conceptual Issues, and representa- 
. tive examples of data from ongoing Havy research programs. 

Purpose 

' * ) 

.» . 

The*'purpose of this report is to make these papers available on a wide- 
spread basis. They arc summarized below and presented ixi^ full in the following 
sections. */ ' ""^ * ^ 

"Historical Per^^yfetive on Literacy Training in ^he Nayy" ' 



The first paper v{as prepared by Dr. John D. Fletcher. The author 
dlvidefi Navy history ron this subject into two areas; before and after 1943. 
Up to 19A3, the incv^easing importance of literacy among enlisted personnel is 
related tp technological advances, the duties of the Chaplain*" Corps, the 
appearance of enlisted hindbooks, the use of written screening tests, and 
literacy training in a Navy prison rehabilitation program. After 1943, 
pecial in-^se rvice programs began to appear. These became progressively 

re sophisticated in terms of curricular content,, individualization^ student 

\^ . . - \ 

^Sticht,\T. G., ^nd Zapf, D. W. (Eds.). Reading and ReadabJJ.ity 
Research in the Armed Services. , ^ 
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selection, evaluation, and supporting research. -Fletcher makes it clear 
. that support for such ^©grains varied directly with quality declines in the' 
manpower pool, response to special programs such a^ Project 100,000 arid, 
most particuJl^drly, mobilization. ' The aa*thor feels that con^^riued support 
of literacy training by the Navy depends on the development of the concept 
of job-related or functional literacy training. ' '''' 

"Literacy Research in the Navy" , ^ • ^ 

The second paper was prepared'^by DrV Thomas MV Duffy. 'The author 
begins by characterizing currept concerns with literacy levels in the Navy ^ 
as turning on- the apparent. larfee discrepancy between personnel reading 
ability and the reading diffijtulty of much Navy>^technical writing. He' then *; 
proceeds to present djata from" two" recent invfesti^gations carriec^ out at the 
Navy personnel Research and Development Center^x The first, a study that 
compares reading ski^lls with- the' difficulty of rfecruit and apprentice school 
reading materials, shows that there* 'is a clear skill deficit in about 1 in ^ 
5 recruits. Further analyses relate' recruit reading Levels to basic t^st 
battery scores, amount of education, r^ce, and the probability of attri- 
tion from recruit training. The second study examines reading skills in a 
sample of Navy Class "A" School students. When' reacfing skill was compared 
to the reading difficulty o'f the manuals written for each of the "A" School _ 
. ratings,' some schools were found to have large numbers of men with reading ^ 
deficits. Further analyses indicated that weekly test scores in sorae'"A" 
Schools are more. accurately predicted from a knowledge of a trainee's reading 
ability th^n from his basic test battery scores or a-nonverbal measure of 
general intellectual ability Reading, skill appears to be most predictable 
irt schools with, a high proportion of low-ability readers* Duffy contrinues 
his paper with a review of current Navy /Marine Corps literacy training pro- 
grams.^ Four programs are cprtpared on several student and instructional^ 
variables, and It is shown that, 'despite wide differences on these vari- 
ables, the reading gain scores for all programs are approximately the same. ^ 
ThfL_rjBa5ions for this and mfeans for increasing th^ impact of literacy, training 
programs in the Navy are then discussed. The paper cbnfcludes with dome * 
preliminary data on predictors of success in 'reading training. 

"Readability Research in the Nayy" 

The last papeh: was -prepared by Dr. ^^homas E. Curran. The author 
reports 6n his stafte-of-the-art survey on iche readability and coraprehei)sibility 
of .tecimical materials. First, he corapareis the distribution' of Navy recruit 
reading skills with t;he distribution of the r'eading difficulty of 185 N^vy , 
rate training manuals. A clear mismatch is apparent, with difficulty ex- 
ceeding ability. Next, lie considers the "^problems "Sfifsociated with measuring* 
the readability x>f text and describes the^ajor formulas and procedures. 
Part/lcij]ar attention is given to. the probleiiPof . technical terminology in 
such measures and to ^the distinction thai* must be drawn between readability 
and\^^prehensibl.lity. Curran points out that, although the readability 
of a passage can be adequately- indexed from existing formulas dealing with 
"countable*' 'features of the writing,.'as of this time, only the performance 
of. a group of subjects on a p^st-reading test can determine its cbmprehen- 
/sibility. : He concludes this section with a discussion of means for specifying 
the reading requirements of Navy jobs. Curran next reviews reseai^ch on the 



production of readaT[>le writings Advice from writers' style guides is 
compared and found to be in cbnside):able disagreetnent • Curran presents a 
diagram of the iterative relationship that should hold- between the predic- 
tion and the production of readable writing. The paper concludes with a 
review of existing and developing procedures for automating the prediction 
process. These include the Navy Automated, Counter; the Automated Readability 
Index; the Reading Ease Assessment Device; the Computer Aided Revising, 
Editing, and Translating System; and the Technical Review and Update of 
Manuals and Publications System. 
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HISTORICAL PERSPECTIVE ON LITERACY TRAINING IN THE NAVY - ' -* 

/ C ■ ' J. D. Fletcher " * * V 

History seems to be not so much a record of what has happened as 'a record 
of what we remember, and any historical perspective is most probably' a per- 
spective on per^jx^tives. This is certainly true of t^e current historical 
perspective on literacy training in the Navy. Because of the subjective , 
nature of^the'data that support it, this perspective is divided into twd 
parts: a very brief part dealin^'with all of Navy history prior to 1943 
and a more extensive part beginning in 1943 and ending with the present. 
Further, very little information is presented on rjeadaiility and technical 
writing, historical information ob these' topics doufTtless exists, but it 
is burled in the instructions and o.fficial Correspondence of the Navy. DeparX-*- 
ment. } ^ , ^ ^ 

• • • • ' ■ r 

A comprehensive, thoroughly satisfactory definition of literacy trraining / 

was not attempted in this report. A rough descnip^on of literacy training 

as an attempt to bring personnel who read bfelowTKe 4.0 grade Level up 

to that level appears to serve fairly well the needs and scope of this , 

t. In the history of Navy training, this description emphasizes 

^ng for enlisted men ^ho are in their first tour of duty. 

Literacy Training Befote 1943 * , • 

Enlisted personnel are, at Best, neglected in military histories. Battles, 
tactics, and technologies tend to be rec6rd^l|in some ietail, but the atlllty. 
and character of the enlisted force that ai^^asic to. any military service^, 
are often obscured, by the statistics of mai^l^er. suppiy, loss, and demand. ' 
If it is reasonable^to assume that enlisted personnel acquire a greater-" 
significance as the technological demands of their duties increasei then/ 
their neglect in histories of the United States Navy is partlpularly re- 
grettable. It is difficult to re^d any account of enlisted life without 
bringing away an impression that Nauy duties hav# always demanded sub- 
stantial technologicaiv^^^apabilitlM^ introductibn ot stgdm and electrical 
systems aboard^ ships obvioaBi;^^^J|I^feased the technoloclral demanda:rof Unlisted 
Navy jobs as Cummings (1929) , "HaTrjod (1973), Patter (1913) , and others have 
indicated, but discussions, such as those of JLuce (1890) an^ Niblack (1891), 
of training pr6blems that Acisted in the earlier, sailing fleet indicate 
J. that substantiilly more than disciplined responses to oi^ders and knowledge 
of nautical tejlnninolpgy were relevant objectives in transforming "landsmen" 
into seamen. /Most of this training was accomplished on-the-job following 
the apprentice, journeyman, master craftsman model. *It required listening 
but not reading skills, and it continued throughout a sallpr's career. 
Despite the predominance *f this mo<Je of training, there were s^Lgnificant * 
efforts as e^irly as the first half of the 19th century/to provide instruc- 
tion in the basic skills of reading, writing, and arithmetic to Navy per- 
sonnel, fhere was no land-base^ training ^staljllshment at this time and 
basic skills training took pl&ce entirely aboard ship., at dock^ide and 
while 'the .ship was underway. There appear to be two primary reasons for 
the efarly literacy training: the religious reform movements of the 1700*s 
and the assignment of teenage boys to the fleet. *S 

■ ' ^ ■ ' • .'5 » ■ 




^ In- the late 17th century an,d during much of the 18th century, a major 
transformation In Western civilization took place under the auspices pf" 
the Enlightenment, Leaiders of this movement placed great faith in human 
re'ason backed by the findings of science and submitted to question all 
authority and absolute -standards". As a result, a sympathetic apd humani- . 
tatlan outlook on the. condition of all men Was st'^inulated , Specially by 
•£5l^gi3"^'"an'iies tat ions of this movement. Protestantism particularly 
^<wr^€d an enlighteiied self-interest on tjie part of Its followers by em- 
phasizing good, works and the notion thafe^very man- is his brother's keeper. 
Heaven Would be won and past wrohgs atoned for, if each man would firmly 
embrace religion and help his fellow man, especially. his less fortunate ' 
fellow man, to do ttw, same. Some membfers of. the Evangelical movement, which 
grew naturally from the\Enllghtenment , 'chose to focus their Interest oft the 
sailors of the naval arid^ifrerchant. servl(5fe. Revivals were held, Sunday 
schools were conductea,. ^nd tracts were disfcrlb^ted. With the distribution 
of the tracts came the -realization that the Word of God was inaccessible to 
many sailors because they could not read. Moreover, sailors' moral welfare 
appeared endangered because their lack of arithmetic skills' made them easjr 
prey for the peddlers of prurience who were naturally drawn to the full ° 
pocketbooks and poorly edufca ted minds of newly disembarked sailors. So it 
was that the first to minister to the need for essential skills training 
among Navy enlisted men were the early Navy chaplains (Langley, 1967). ' 

The regulation of 1802 described the chaplain's duties as the following- 
He is to i^ad prayers at. stated periods; perform all 
funeral ceremonies over such persons as may die in the ^ 
service, in the vessel to which he belongs^ or, if dire^^ted . 
by the commanding officer, over any person that may die 
in any other public vessel. . ^ . 

He shall perform the duty of a schoolmaster; and 
to that end he » shall instruct the midshipmen and " 
volunteers, in writing, arithmetic, dnd navigation, and 
in whatsoever may contribute to render them proficients. 
He is likewise to teach the other youths of the ship,', ^ / 

according to such brders ais he shall, receive from the 
captain. He is to be diligent in his office and su£h as ^ 
are idle must be represented to the captain, who shall 
take notice thereof. (Burr, 1939, p. 111). ' . ' 

In addition to chaplains, there were schoolmasters and teachers in thk 
Navy (as evidenced by the law of March 1799 assigning them three-tw^htleths ^ 
of prize money, which- was approximately the amount assigned tb warrant . 
officers) but, in general, the schoolmasters made a poor showing^ AH^g^a- 
tions of sloth and drunkeness on their part appear well founded. ' School--, 
neasters' duties^ varied with their commanders, but they were geneMUv 
charged with instructing the boys, apprentices, anS midshipmen acS^gned ' ? 
to ships. The employment of schoolmasters was never extensive Imthe N^y 
and It gradually died out. However, the history otrtf^y chaplalnl.is far ' ^ 
more honorable than that of thS .schoolmasters, and the ghaplaln Corps 



roalntai 
througho 



tructlon for enlisted men 
). There was, of courser 



n^d it Inr^ essential skills ^Ini 

little systfem IcV " ^^^^ In8tructl6n, j nd Its success most probably 

keyed on the J^aJ than cognitive well^t elng of its students. 

Apprentices ^ "^.^ 

. • Fro™ the\e«inf»> ^^e Navy, there were boys assigned to ships ^ 
aV^-- ^« .» ^H-^^*^ their employment- arfd treatment were embodied in the 
*4"rZ"cl .ll^'ll 1" 1863. .nd 1875. Of ,11 th. tr.inln-g 

r^ntures befo^ th<^ ^Panish-AiBerlcsn War, only the naval apprentice program 
br«i?^^3 I II oltif^ the modern Navy (Harrod. .1973). De«|#e this fact, 
?^rioDre;t?c'''^Ji^f"' ^"ffe'^*^ unpromising beginnings. The M effort failed 
beca-" «^nr^!.l'!#.>°P««» of obtaining coi«l««ion8 were not fulfilled and 



bl'in-! of^'In*^ lilrf^** »"tiny in 1842 on the training «hip SOMERS in which 
T-on of the /ir'pr''^ °^ War v88 hanged, probably wrongfully (Langley, 1967). 
Th 1855 proa^ w<>^ Interrupted by the outbreak of the (Tivll War. The 1863 
effort was unJSe<^^!i:i:/«<=«"«« apprentlce^i were again disappointed in thelt* 
hdp^es of obtai;^^Jig ^>»J«8ions. Howeve/*. the apprentice system, continued 
to h«. rpvlvpd Ic.il' °^ ^^^y as'^lous prohlena the Navy w8s experiencing in 
7 I ArZTi *'ith native-born seamen (e.g.. Luce, 1874). In 1875 

TCu:iTJLl^Kf^t'.^-^ ^oys lA-18 years of age to serve a. apprentice. 

Ignl- 
1973), 

the 

Ived until It was 
seaman rating with 
en evolved the proto- 

Recrult t^ inin^ "^^^entlal A motivated by a need for stsndardl^a- 
tl in tralni^^ yJ^^^^^ and apprentices for shipboard duty. A natural 

ri4^^^8 training thatXyas employed very quickly after the 
means for stanj^rcij^g^^^^^ publication of drill books. Fullaw's 

LnJ^ bI^^ ^^"^ McLean's Bluej acket's Manual both appeared In 
—^^^^TTT^^^ until thPltip^ and McUans' manual Is currently 

of November 1902, the Navy 




1902; Fullam-r^OoK iirr^^ ^'^^ '"VT/ 

4r> mI ^iry^^^ h ^^^^^^^ General Order 114 
In Its nineteenth ^ ^ i X. 

n*. i-isJ|/^A Recruits to know ehe con 



Officer's Dril l Bpcyj? * 



ontents of the Recruit's Handy 
ubllshed In 1902 the Petty 



these handbooks signaled the fact that oral Instruc- 

:e- 
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of this technical documentation. In any case, the appearance of the drill 
hooks signified an official expectation ^at seamen would be able to read, 
and literacy effectively became a requlsOTe Navy skill. 



\ 



. Despite 'a national requirement for llt^racj^^ about 11.3 percent of the 
United States , population in 190(f could be clasa'ified.as Illiterate (Harman, 
1?70). There were no systematic attonpts to screen Navy recruits until 1925 
^Harrod, 1973), and Illiteracy among Navy personnel*' became increasingly 
serious. Although -there is no .direct reference to this effect, the systema- 
tic screening that began In 1925 Included vrittep tes^s,. success'ful perfor- 
mance on vlilch required literacy. It sjeems likely then, that th^ incidence 
of Illiteracy in tJje Navy was substantially reduced by the use of these ^' 
tests. . ' - 

t 

Aside from the work <f^ the chaplains, the only formal literacy training 
that appears to have been supported by •thfe N«vy in the pterlod 1900-1943 was' 
In Portsmouth Prison where some effort was made to rehabilitate men who were 
classified and jailed as deserters because of their inability to read furlough 
orders (Potter, 19lB) . These men would go on leave ^d return on wHat they 
tlioup.lit was tlie appropriate date only to find . themselves schedulied for court- 
martlnl. 

])esplte the screening process begUn In 1925 and official policies for 
their exclusion. Illiterates continued to appear in Navy billets through- 
out the entire period jj^Special Training Program^ 1951). Other ttain the 
rehabilitation program at Portsmouth Prison, ao official efforts were made 
to help these men achieve literacy. There was, and Is, considerable unskilled 
labor required In many fleet billets, and these men were typi<:all7 assigned 
to do this labor. As might be expected', rates of pronotlon and reenlistmAt 
amonr, these men were not high. During Wofld War II, manpower supply began 
to run substantially short bf demand and in June 1943 the Navy reluctantly 
agreed to accept Its fair share of Illiterates under Selective Service, 

Literacy Training In 1943 and After 

The Special Training Program 

Altliough, prior to June 1*»43, tliere was no offclclal rcco^ltlon of 
tlio fact tlint room would have to he made for enlisted personnel who could 
neither read nor write, a great many men In this catef^iry were already 
servlnj» in the Navy. Immediately after Pearl Harbor, recruiting stations 
%/ere released from the obligation to administer the General Classification 
Test iCCT) to applicants •ftd, since this regulation remained In abeyance • 
until the^atart of 1945, mlhy Illiterates found the^r way Into the Navy 
throughMttadltlonal recruiting channels (Special Training Program, 1951). 
In AuRu^Pl945, the Director of Training Indicated some of thp problems 
the Mavy and Illiterates experienced with, each ^o'ther in the following 
summarv: 
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(1) At tlmns the porjod allowed for recruit training was 
eontractetl by the demands of the service to four or five 
weeks. Under these circumstances ifthe trainee was obliged 
to acquire a large part of his instruction thr^wlfeh reading, 
I^was found that^it took approximately four tim^s as long 
to train an illiterate to pnerform an average Navy job as ft 
did one who coiyLd re^d. 

(2) The estaMfishment of a training program which did riot 
depend on thf u3e of printed matter would JjllVe been both 
difficult ^'d expensive. Experience showe« that it was 
simpler and more economical to teach nen tq i^ad than 

to- devise materials which did not require this -knowledge. 

(3) * The establishment of a smooth adminis?rativQ^ routine , 
was grossly complicated by the presence of pon«*-Wader». 

A system for the rapid handling of records W(^s a virtual ' 
Impossibility where men could not fill out information 
blanks^ pay recipts, proficiency slips, allotment »**aj:ds, 
etcetera. ^ . 

(4) Sufficient ^ucation to read safety precautions was 
essential fqr men working .with machinery^ high explo- 

^sfves» and heavy cargo. Serious accidents were traced 
directly to men's inability to read warnings and study 
safety instruction. ** 

(5) A social barrier ai seriovs implications wds found 

to exist between literate and illiterate personnel. 

f 

i 

(6) The administrative dualism resulting from putting 
literates and illiterates together caused confusion. 
Literates tended to resent the long oral directions 
which they had to listen to for the sake of the 
inmates in their number. 

(7) A very large number of minor disciplinary problems 
were the direct outgrowth of misunderstandings caused by 
Innhility to read station orders, watch bills, leave and 
liberty regulations, and safety instructions. 

(8) An inability to read and write letters constituted among 
Illiterates n serious morale" problem and consequent 

oI)Stac le to sat isfactory adjustment to. naval life. 
It became increasingly evident that a knowledge of 
reading and writing helped to overcome a feeling of* 
inferiority and tended to develop initiative, aggredt-> 
siveness, and more willing acceptance to the conditions 
of military life. (Special Training Program, 1951, 
pp. 2-3) 
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Despite this analysis which was written after the^fact, there Is 
substantial evidence that aut1ho«ltles .were reluctant to accept responsibility? 

' for setting up a special literacy program long after the need for such a 
program became obvious. However, as the situation gradually worsened, the 
Navy stumbled Into a situation that requ^ired recognition of the need for 
a special literacy program. On 30 September 1943, the Naval Training 
Section in Norfolk, Virginia reported that illiterates were being received 

; from boot camps in increa^ng numbers. Since all the facilities at this 
section were need for the destroyer and destroyer escott training prograias, 
permission was requested to transfer these personnel to the Naval Training 
Section at Bainbridge, Maryland for further instruction. Evidently, the 
permission was granted without due copsideration of the practical consequences 
af this decision. The result was that Bainbridge found itself deluged wl^ * 
illlterates'and appealed to tlfll Bure^u^ of Naval Personnel for help. The^ 
immediate response of the Bureau wgs to cancel the permission that had pre- 
viously been granted to Norfolk. However, as a result of these events, 
the need for special literacy training was brought to command attention 
(Special Training Program; 1951). ^ 

The presence of a growing body of illiterates in the Ifavy created 
a training problem that it was totally unprepared to face. Luckily, as 
a thorough review of World War II literacy training programs bjf Fattu, 
Mech, and Standlee (1953)' shows, the foundation for solving this problem 
had been laid much earlier by the work of the Civilian Conservation. Coms 
(CCC). , ■ ' ^ * 

The CCC was established in March 1933 primarily as a means for providing 
productive employment fo^ft^g men during the depression. Although it was 
administered by the Army fBHUghout its 9-year, existence, much *use was made 
of paofessional educators^^Hieveloping and gi^ldlng the educational phases 
of the program. The CCC education program was secondary to the work pro- 
gram, and the literacy program was only a small part of the education pro- 
gram. It was created to serv^t the estimated 6 percent of CCC enrollees who 
were functionally illiterate in the camp life situation (Couch, 1944). 
Nevertheless, the literacy training program did exist as qn identifiable 
entity, and it served as a foundation for the development of similar programs, 
first by the Army in 1941 and later by the Navy in X944 (Fdttu et al., 1953). 

The Army program was discussed by Heath (1946), who pointed out that 
there were three distinct groups of iillterates targeted by the Army'pro- 
gram: English-speaking illiterates, ion-English-speaking illiterates, 
und Oriental literates. Training way tailored to the special needs of 
each of these groups. The teaching program for the English-speaking 
illiterates passed through five distinct phases. These phases were se- 
quenced and a student had to master each phase before proceeding to more 
advanced ones. Heath describes the phases as the following: 

1. Consonants and Key Words.. Sounds of the consonants were taught 
in this phase by associating 21 key words with Eng-llsh consonants. 

16 



10 



2. Monosyliables and Vowels. Nonsense syllabled such as ter, ker, 
nub, etc. were initially taught In this phase in an effort to train students 
In the relationship between ortbogi:apJiy ^nd sb'find. \ 

* 3. Introduction of Polysyllables. ^Students wera— Caught 60 analyse 
polys^ll/ables Into monosyllkbles.. 

/4. Sentence Structure^ and Word Recognition fronw Content. Furt 
Instruction In word attack was presented and instruction in constructing 
sentences and learning (recognizing) w6rds fr^m context was added in this 
phase. ^ 




5. Composition and Expression. Studc^nts were tai%ht to read mrf*^ 

in this phase. TMy v^r^*^ 
dictionaries and tel^photte. 



prepare military messages and personal letters) 
also taught; the use of such basic resources as 
directories. ' 

Discussion of the Army's literacy program is^elevant because, when the* 
Navy finally faced the need to produce a'literacy training program, it 
turned In September 1943 to the Army for guidance, and the workbook 
material developed for the Navj^was based on the five phases discussed 
aboV^e., ' 

On 22 December 1943, the Imminent appearance of a special literacy 
program for recruits was announced by the Navy. On 23 Decertber 1943, ^the \ 
Naval Training Section at Gfreat Lakes, Illinois was directed to prepare ^ 
tot the arrival on 3 January 1944 of an initial draft of 420 white llliteraae 
In March 1944, two Navy progr^s for literacy were established: one at 
Camp Peary, Virginia for Whites and one at Great Lakes for Blacks; Flans 
for the gamp Peary program called for a weekly Input of up to 500 trainees 
with a total capacity of 6000. In fact, the ifotal enrollment at Camp Peary 
quickly grew to 10,000 in April 1944 (Special Training Program, 1951). 
Notably, both these programs were set up as an Integral part of t'ecruit 
training; no programs were established for Illiterates who were already 
In the Navy. At no time did the Bureau of Personnel formally accept re- 
sponsibility for training illiterates who were above the recruit level; 
however. Informal support was given to commanders who wished to aid 1111- 
terates under their command with the dissemination of literacy training 
materials throughout the fleet. 

The curriculum that was initially devised for the literacy programs 
In early 1944 provided for only 133 hours of instruction in reading and 
wltlng and 73 hours of Instruction in arithmetic, for a total of 205 hours 
of Instruction out of the 576 hours originally called for. However, by 
January 1945 a considerably expanded and Improved program had evolved. 
Four basic assumption^ not previously annunciated determined the form of 
the Special Training Program, as it came to be called. First, it was a 
training program for adults. Although unable to read and write, the trainees 
came to the Navy having command of a well-established oral vocabulary 
together with a fund of experience that put them beyond the appeal of 
grade school readers. Second, the trainee's were the products of a wide 
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variety of environments, so that the only interests they could be expected 
to have in common would grow out of their iftfe in the se^ice. Third^ t\\e 
limitations on, time allowed for acquiring literacy made it mandatory that 
the program be rigidly functional in natur^. x,^ nominal proficiency grade, 
of 5.0 in reading and writing was establishdi as the teaching goal, but 
the purpose behind the program was simply to qualify men to read, write, 
and figure sufficiently well to perform all essential Navy' duties. Thus, 
it ^as'expected that graduates of the ^ojurse would be able to re^d watch 
lists and safety precautions, and would be able, to fill in beneficiary 
slips artd small stores chits. On the other hand, there would be no attempt 
to^ indoctrinate trainees formally in sucn tefineraents as>jcapltalization, 
spelling, and punctuation. FourC^, it was assumed that* tpie vast majority 
of instructors would be inexpgr^iet^ced in the type of teaching expected 
of them. They could be expected to rely unduly on lecture and bjlackboard 
methods and to encourage parrot-i'iKe memorization of lists of wqirds without 
developing the skills oL analysis and synthesis ' that are essential to 
literacy (Special TraiJBfc Program, -1951) . The CCC literacy niajterlals 
were called the Camp Ll^^ ^rics* and the Artny matejrlals were called the 
Army Lif^ series, so naturally the workbooks, .basic reader?, supplementary 
readers, tests, and teacher's manual developed for the Navy were called 
the^ Navy Life series. Private Pete was replaced by*^Seaman * 

- , Development of the program materials was described by Ross \l9A6) : 

In writing this program, some radical departures 
from the conventional were taken, because the situation 
and the nature of the students and instructors demanded 
them. For exampl'Sfe, a "reader" in the handi of an un- 
trained instructor at the outset of the prpgram would 
result in a static classroom situation in which the 
students "read" orally in rotation, with prompting, until 
the page has been stJLrtually memorized^ In the Navy Life 
series, therefore, the first book is not a "reader," hut 
a workbook- type tQxt which forces the instructor down from 
the platform among the studenC*s. The first of the readers 
is not introduced until considerable reading ability is 
developed through chart, blackboard, and workbook reading 
experiences. When it; is introduced, no new skills or 
words are required for some time, and the student can 
read It easily for meaning. Aa a result, the student is 
literate so far as \the readers Are concerned from his -^^ery 
first experience wiVh them. • . 

V 

Comic b^oks are exceeded in popularity by no other 
reading material. So, later in the program, when .^ey can 
he handled easily ^^..cDtnic books are. introduced ^foA^Mid , 
supervised classrpom Tsuplemervtary reading. TKes^lR'^iv^ 
regular commercial comic books, carefully selected in 
• advance of publication, and then rewritten with a core ./ 
vocabulary basic to the Navy Life program. (p. 204) 

" « t 
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Notably the cornerstone of this program was not the basal readers, 
which was proba'bly the case In civilian Initial reading Instruction, but 
the program's two workbooks functionally entitled Navy Llf6 Book I and 

' Navy Life Book II * Both books were constructed on a .basic vocabulary that 
derived first from words shown by research (what sp9f|Bxc research Is not 
In the record) to be an essential minimum /or literacy, and then, to as 
great an extent as possible ^ from nav^l terminology. Fans ^f Leonard 
Bloomfleld will be Interested In Figure 1, which Is the ffrst "story" 
tjbat occurs In Navy Life Book I , The emphasis on the single spelling 
pattern "at" embedded In hat, mat, and sat will seem very familiar to 
those acclimated to Bl-oomf leld's "Nan can fan Dan" (of. Bloomfleld & 
Barnhart, 1961) • Extensive reliance was placed on Illustrations to 
Indicate vord meaning, but other deylces such as a visual acuity test and 
Illustrations of phonetic similarity were also used.' It was assumed that, 
by -teaching reading and writing simultaneously, growing proficiency in 
either would Increase proficiency In the other. The ipdterlal in Nav^ Life 
Book I , which contained 400 Illustrations, took as its common denoroln\ator 
barra'^lcs llfe>, which all trainees might be expected to have in common. 
In .the second volume, the emphasis w§s gradually shifted from phonetic 
e,Lements to syllables and from illustrations to conttbct as a means of fur- 
nishing clues to word meaning. The rigid cdijtrol ovct the materiaLthat 

. CQA^<^^e^ls^d Navy Life. Book I was gradually relaxed, in Book. II ,^adtrwas 
flnaTly ' loosened so that any student capable of handling It would be able 
to cp^iduct l^ndependent reading outside the classrootn. Navy Life Book II 
was also prepared with the intention that It should be a useful adjunct 
to regular recruit training, since It contained a good deal of incidental 
Information on such subjects as semaphore, flref luting, elementary naviga- 
tion, naval customs, guns, ship types, seamanship, naval terminology, and 
personal hygiene. ' - 

As It evolved, the curriculum was developed on a flexible scale 
operating between th^ Tlihlts of 12 and 20 weeks. In other wotds, trainees 
received periodic tests starting with the eleventh wefek, and «Ould be 
graduated any time thereafter by shoving that they had achieved the re- 
quired level of literacy. The minimum overall time prescribed for the 
course was 256 hour^ and the maximum time was 528. Within this framework 
the variation In the allowance, for' reading ari(l writing ran fi:oro 129 to » 
312 hours, and for arithmetic, from 63 to 118 hours. 
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Selection for ^he program depended on scores achieved on^tlTree 

tests: 

ll . The General Classification Test (GCT) — a test of general 
ability which in 1945 was reintroduced and glven^ to all incoming personnel. 

2. The Literacy Test (LIT) — a dlrect^measure of reading achievement 
consisting of 44 items .divided into three, subtests: word recognitioET, 
sentence reading, "^nd paragraph lnterpi:etatlon. ' ' * 



S. The Nonverbal Classlf Icatloa Test (NVCT) — a reflection of the 
GCT admlnlsj>erd ^In^ nonverbal terms through the use of pictures and geometric 
forms. The NVCT consisted t)f 75 items divided irito five subtests: picture 
analogies^- f Igure^nalogles, picture classlf icatlon^(oppdsltes) , figure 
- 'classification (opposltes) , and matrlcs (comparable to Raven's matrlcs). 

Accordli^ to Hodges (196^*), the f ollowlng/^reenlng procedure was 

i. All ij?cruits'scorlng^less than a standard score of 35 on the. 
Reading Test (the\QCT, when t^he Reafllng ^est was discarded) of the Basic 
Test Batitery wer.e ^administered the "blT. < V 

. - V 

^ , 2. Men scoring 40 (ec^iivalent to 'S.T) grade level) or better on the 
LlT were considered "literate" and sent on^ to regular recruit training, and 
' those scoring below 40 on the LIT^^Weofe eiven the NVCT. 




« 3. Men scoring higher than^^^ 'on the NVCT were considered trainable 

and sent to the Special Trainings Progtam.^ (A raw score of 34 on the NV.CT 
is between 30 and 35 Standard Score ^ the GpT.) 

4. Men scoring below 34 on the NVCT were sent to a psychiatric unit 
for .closerjexamlnatlon; they were suspected of being both illiterate and 
unipjiiinable. (N. B. - The LIT and NVCT scores of 40 and 34 were later 
changed to 37 and 38 respectively as a result of an unidentified study, all 
records of which have vanished. ) 

In oth^r words, the men sent to the special trid.nlng units were 
those in need of literacy training (low LIT score) and judged capable 
of aAslmllatlng it (high NVCT score). * \ V ^ 

The Navy Reading Alchlevement Examination (NRAE) was also developed 
as a standard measure to determine when students in the varlable^length 
Special Training Program were ready to graduate* BOTh the LIT and the 
NRAE were calibrated against the Gates Reading Sury4y to establish grade ^ 
levels. The NRAE was designed to be functlonal,..a^ tested students for / 
understanding Navy situations in which they might find themselves. — 

There appears to be' a single evaluation study' of the Navy's World 
War II Special Training Program. This study was administered and documented 
by Hagen and Thorndlke (1953) on the basis of personnel records salvaged 
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the Naval^ecords ^lanagement Center, Garden City, New York, Two 
of ^fawere abstracted: (1) backgrorfy[id facts that might predict 
in the Navy^^nd (2) facts about the maPr's career that might in- 
dicatc/his success in Navy duty assignments. Three groups of men were 
identified: 




1. ' The "IlliterateV Group . This group consisted of 1026 men 
inducted into the Navy during Augtrst and S'ept^ber 1944 and initially 
assigned to the Special Training Pro-am at Camp Peary/T^x 

2. The Contj:<ri Group . This gl'oup was selectJd by taking a serial 
number that was/f 1^ digits above the seriaj. numb^er of a member of the 
illiterate group The man thus identified was included^n the control 
group if he was not black, not illiterate, fend came from the same geo- 
graphical area as his illiterate counterpart. If a serial^ number five 
digits higher did not identify a quali£ie<j[ c6unte3?pdrt , one five digits 
below was selected and so on. ^n this way^ a cdhtrol group of 1021 men 
w^s chosen. TWls group resembled the illlteMt'e\Rroup on most geographical 
and ''^eroograplijlc measures. - • / 

^ 3. The Marginal Group . This "group was cc^posed of 999 men who 

had scored below 36 on thq.GCT and who enfiered the Navy at about the same 
time as the illiterates. This group was geographically and demographically 
dissimilar from both the illiterate and control groups. 



Hagen and Thorndl 
g^rou^ as follows: 





described the average member of tlieir llliterat 

t 19^ 




He was inducted in the Navy when fie was ibou 
years old. At the. time of induction, he/wftH single but 
had one or more people who were partially or wholly 
dependent on him for support. Before induction, he. had 
lived in a rural area of the South where the standard of 
living was below the average for the nation as a whole. 
He had completed the fourth grade in school and^left 
school at the age of fourteen after having repeated at 
least three grades. Since leaving school, he had worked 
for his parents or a relative on a non-it^echanized farm. * 
In his spare tim^ he hunted or fished. TO maUe a score 
sible 17 on the Qualifications Test and 
the Navy General Classification Test. 



? 



spare 
of 4 out of a p 
a score of 31 
(p. 18) 



Hagen and Thorndike summarized the differences they found between 
the illiterate and control groups as follows: 

* 1. The illiterates were much more likely than were the control 
cases to be assigned to construction battaiTOTTB, and were less likely to 
be assigned to U. S. permanent party or to auxiliary ships. 

2. The illiterates tended to receive a lower average proficiency 
in rate. Only 50 percent received an average of 3.5 or ojJjSaU *® compared 
with. 73 percent in the control group. 
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^. 3- The/illltera^es^'r^c^ fewer promotions. Only 15 percent 

made petty officer, as compared with 37 percent in the ^ontrol group. 

j 4. The illiterates received paore disc ipllnafyS^t ions. In the 
illiterate group, 2 3 percent had records of some type oA disciplinary 
dctlon, as compared with 11 percent of ^he conti;pl group. General courts ' 
martial .were 10 times as frequent in the illiterate group. 

r 5. The illiterates more f requently^^ltHst ^ime due to misconduct — 
20 pelrcent versus 7 percent. 

6. The illiterates less frequently rec%lved an honorable discharge^ 
&3 percent versus 88 percent. 

7. The illiterates were somewhat more likely to receive a medi^ar 
tion survey, and were the only ^oup to be surveyed for inablllt]^ to ^ 
learn— 19 percent versus 15 percent. " , - \^ 

' ^. The Illiterates were .somewhat more likely to incur a ven^lll^l 
Inflection — ^5 percent versuW 3 percent. -n. 

' ■ ^ 0 1 • • 

9. The Illiterates were slightly more likely to generate a Veterans 
Administration disability claim — 11 percent versus 9 percent. 

In most of the factors that distllfeuished the illiterate from the 
control group, the marginai^o^oup occupies an intermediate position, usually 
nearer the illiterate group than the control group. The only exception to 
this is the case of disciplinary actions; the marginal group were more often 
in trouble and their offenses were more serious. 

^ The 'Hagen and Thorndike study is interesting, but it is essentially 
a study of personnel at differftit mental leybls. It does not have much to 
say' about the effectiveness o£ literacy training. It does, however, tell 
something about the success illiterates in the Navy. In general , it 
seems reasonc^le to conclude, with the authors, that many or ino^t of th^ 
illiterates appeared to make an accpetable adjustment to the Navy. 

.After the war, screening of illiterates with the GCT, LIT, artd 
NVCT continued, but the Special Training Program was discontinued in the 
course of general demobilization. Ginzberg and Bray (1953) estiinated that 
35,000 men were assigned to the Ite^vy'a Special Training Program in the 
course of Its^hlstory. . ^ 

Recruit Preparatory Training 

In 1950, with the influx of volunteers during theVKorean War, 
coninanda were once more authorized and encouraged to identify and train 
any illiterates who might be aboard. By^^the spring of 195L, literacy 
training was being conducted Informally in after-hfiurs programs at the 
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three recruit-^ traifiing centers (Bainbridge, Maryland ; Great Lakes, Illinois 
and San Diego, California). Bf September'^1951, literacy training was 
planned on a full-time basis under the new title Recruit' Preparatory ^ 
.Training (RPT) (Standlee, 1954). Officially, the m^in objective^of the 
program , was "to teach selected recruits to fead and understand instruc- 
tions and t<^,prepare them to absorb military training. Recruits should . 
attain a level of proficiency irt reading which i« comparable to completion 
of the fourth grade" (Curriculum for Recruit Preparatory^vTraining, ^1953, 
p. 5). Further, ap accepting classroom atmosphere was to be created, as 
indicated by the following guidance provided by the Bureau of Pe^onnel: 

* - \ » * 

1-. >lake the first reading tasks simple enough to 

; insure that the recruit experiences an ea3:ly feeliri^\pf « 

success in learning to read. J 

-2. Show the recruit that his low reading achieve- 
m«^is a handicap which must be overcome in reaching; 
his goal^-becoming a useful sailor. ' 

3. Create a permissive classroom atmosphere and 
start where the learjner is. The individual recruit 
is the one who has to learn. The most the instructor 
can do is guide and help him. The instructor should 
guard against a highly directive, subject-matter-centered 
approach which is on a level that never reaches some 
recruits. • ■ 

■ ' V 

4. Integraft^^ of military subjectsvy /ith rea ding, 
writing, and aritlinetic. Some examples of how thi^ can 
be done are listed below: ^ 




a. Tt^ instructor inclydes some topics related 
to seryicf^in the Navy at appropriate times in his 
reading, writing, ^and arithmetic classes. This 
procedure will probably be more effective during the 
latter part of RPT. 

b. Use of visits tq^c?sh/ps or parts of the 
training center. Trainees can can write about what 
they see, read accounts to each otherV^learn NavaT 
terms, etc. *^ ' 

c. Kearn tjp read safety signs found on the center 
or aboaifd ship.-* 



d. JPrepara-^jioh o£ RPT news sheet and use of local 
newspapers ^and ahTiouncements of recreation. 



e. 



^ett€ 



Provide guidance in writing tetters home about 
barracks, field-day, bunks, meals, training activl|ties, 
etc . ^ 
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f • f^Plliarizatibrt with types of mateMal found in • 
The Bluelackets' Manual , libraries on the center antf* 
aboard. ship, and courses available through ,USAFI, 
(Curriculum for Recruit Preparatory Training, 1953, p. 11')' 
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C The curriculum materials were, wtth minor^pdating, com^sed of 
the UavY Life series -prepared f oi*^ thAWorld War II Special Training Prijgranf, 
although u^e )rf other supplementar';^ materials was i^ncoiH^^ed (Standlee,- 
Fattu, & Auble, 1954a) • The ^election procedure fw: *RPTS^as the following, 
as descrl!bed hy Hodges (1964): * w . ^ , 

' ■ - ^ . ' ; 

' 1, All men sco|d.ng below\36 og the GCT were administered both the 
NVCT and LIT. / ^ X 

: • . : . ■ ■ 

2. Men.scpring 38 , and i above .on lyth t^s tfr were considered literate 
aAd trainable and isent to regular recruits "trainTng. . . 

3. Men scoring 37 and below on the LIT (38 on the LIT is about a 
4.7 grade ievel) and scoring 38 or higher on the NVCT were considered 
illiterate but trainable and sent to .special training. 

i , ' . . ' 

4. * Men^scoring less than 38 on the NVCT and on the LIT were suspected 
to be untr|^inable were sent to a neuropsychiatr|fcc unit for further examina- 
tion.^ From the neuropsyc^iiatric unit, men were sent to special training^ 
regular recruit training^ (on a trial basis), or discharged. . ' 

Referrals could &1sd be made to the Special Training Program by Company 
Commanders in regular recruit training. The NRAE with a new form addled vas ^ 
restored as an end-of-course criterion. The 5.0 grade level was^^nil the 
course objective. Students were given 7-9 weeks to complete the course. 
Anyfebserver who was sent to the three RPT centers in 1953 reported ^that, 
in general, the selection and curriculjiim procedures in use followed the 
Bureau's directives, that a total of 239 trainees were enrolled in all three 
centers, that 85 to 94 percent of the trainees successfully completed the 
RPT» program, aiid that they took 6-7 to 9 weeks to complete it (Fattu. Fay, 
'D'Amico, & Standlee,. 1954). *^ . 

Two evaluative studies of RPT were completed. A study by Cofer 
(1954) investigated the effectiveness of RPT in achieving its most Immediate 
objective, preparing the trainee for regular recruif training. Standlee 
(1954) dealt with the more ultimate criterion — performance of RPT graduates 
in fleet assignments. ^ } ■ . 

A principal concept in Cofer's study is that of adjustment, spe- 
[f ically adjlistment of JIPT graduates to regular recruit training. For the 
'purposes of this study, mental health considerations were set aside in favla^t 
of adjustment that emphasized, first, adequacy of performance of recruit 
duties, and, second, attitudinal and motivational factors iit' relationship 
to the Navy, recruit training, and civilian plans. Fourteen rating scales 
were developed to assess adjustment in the first sense, and an ^0-item 
questionnaire was developed to assess adjustment in the second sense. Two 
groups of subjects were identified^ one at an early stage of recruit training 
(Group I) and one at a later stage of recruit training (Group III. Within 
each of these groups, four subgroups were identified: ^ 

■■ ■ y 
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1. RPT graduates: .^roup I: N = 30 

^ Oferoup 11:- N « 21 ^ 

2. Recruits \i±th GCT scores below 3&rfbut not RPT graduates: 

"Tt y ' ■ Group it: N = « ^ 

Group II: N =' 18 . ♦ 

\ 3. Recruits with GCT scores between 35 and 40 inclusive: 

^ - ' Group I: N « 29 . 

•Group II: N « 46 

^ 4, ,Recruits*with GCT scores €t^e ^0:' . . , 

, '■ ■ . V . / ' V' .• . 

Group I: N « 30 . * 

f ' . . _ ' Group II: N « 49 

Each subject was evaluated on his adjustment to regular recruit training by' 
peers and Company Commanders separately on the ^4 scales reflecting adequacy- 
of performance in recruit training. ^ - ' 

^ In generaf'ly members o£ the RPT subgroup resembled the members of the 
high GCT subgroup on the criterion scales more than they did members of the 
intermediate subgroups. The results of the peer ratings for Group I subjects 

were the f fallowing: ^ — , , < , r 

' > . ** 

1\ The high GCT subgroup and^ the RPT subgroup were rat^d signifi-^ 
cantly superior tp the intermediate subgfoups on personal cleanliness, 
military bearing, bunk and living quarters, general Navy performance, and 
leadership.. 

2. lifee RPT subgroup was rated as significantly ;?uperior to the other 
three subgroups on marching and maneuvers and physical drill iSat^ 

3. The high GCT subgroup was rated as significantly superior to the 
other t^ree subgroups on quickness to learn and response to orders. 

' 4. The RPT subgroig^ was superior to the interm/raiate subgroups on 

care of clothing. t ; . 

The Results of Company Commanders' ratings of the Group I subjects were tHe'^ 
following: 

1. The high GCT subgroup was significantly superior to the/other 
three subgroups cm quickness to learn, respS^se to orders, willingiiess to 
work, and general Navy performance. 

2, The high GCT subgroup and the RPT subgroup showed superior 
ratings on care of cloth|.ng and military beafing. 
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The pattern of ratings for Group II was essentially the same as that obtained 
for Group I. ^ . 

In. general. It seems reasonable to conclude with Gofer chat RPT 
aided recruits in adjusting to regular recruit training, but it is still 
difficult to <letermine irhat contributions the cognitive aspects of literacy 
training made to this adjustment. 



Standlee (1954) studied three groups of recruits in his investiga- 



tion: 



1. RPT graduates;! N « 611. 

2. Marginal recruits with a OCT of 35 or lower, an NVCT 6f 38 or 
higher, ai^ a LIT of 38 or higher: N - 2414. ^ 

P» Typical retruits with a GCT of 36 or \^0iex\ N - ^ 

The 5312 total subjects were origimally sele^cted by identifying 
all RPT graduates and marginal recruits processed during the period 10 May 
1952 to 1 September* 1952 and a random 10 percent mt the typical r#cruits pro- 
cessed during the same periodic Data on the fleet performance of these re- 
cruits were obtained by mailing out questionnaires to their Conmanding 
Officers during July-August 1953. Most of the questionnaires were returned, 
5023 of which were suitable for analysis — an effective response rate 
of almost 95 percent. 

' The RPT and marginal groups in comparison with the typical ^oup 
were much more often assigned to general duty (unskilled work) and to 
duties that did not require as much reading skill. The two groups were 
less favored with promotions, had lower average performance evaluations by 
Supervisors and Commanding Officers, mid had a higher proportion of disci- 
plinary actions and days lost due to misconduct; or sickness. In the opinion 
of D^ision Leading Petty Officers, the two lower groups generally showed 
less promise for future advancement and profitable service to the Navy. 
The two ISwer groups, however, indicated more intention to reenlist than 
the "typical** growp* 



Overall, the two lower groups tended %o resemble each other, end^. 
to be somewhat Tess effective in performance than the "typicals." Vftiere 
differences between the, two lower groups were found, they tended to show 
the marginal group to be superior to the RPT group. However, most of the 
differences between the three groups were small and none of the groups had 
characteristically unacceptable performance; the majority of members in 
all the groups were Judged to be serving the Navy adequately. 

.1 

Two other relevant investigations came out of the jiensral contractual 
effort that sponsored the Cofer and Standlee studiflP. Sdndlee, Fattu, and 
Auble (1954b) investigated* the quality of Navy technical %n:iting by tabulating 
the frequency of words appearing in the Bluejackets' Manual (lAth edition). 



This is Your Navy , All Hands , and the Maval Training Bulletin ; and Fattu 
and .3tandlee (1954) applied two Flesch Readability formulas to the following 
publications: Blue^i acket s ' Manual . Stewardgnan (Manual), Fireman (Manual), 
Steward and Cook (Manual), Commissaryman (Hamial), This is Your Navy . All 
Hands, and Naval Training Bulletin , It seems\ unlikely that these investi- 
gations represent the first attempts to systefiatically judge the quality 
of technical writing in the Navy, but these a\se the first that appear to 
be available in the official literature. The tfesults of these investiga- *^ 
tions are predictable: Standlee et al. showed that even experienced writers 
and teachers use too many rare words and exclude too many common words when 
relying on their experience and common sense; Fattu and Standlee found that 
standard, essential Navy publications were, most probably, too difficult 
for Navy enlisted men — the average Flesch readability score of their sample 
was 61.7, which converts roughly to a ninth grade reading level. 

With the end of the Korean War nt manpower again became 

available to the Navy, and in 1957 the RPT program was discontinued in 
favor €>f a shift in research and administration emphasis toward problems 
connected with higher-level personnel. Subjectively, many persons in the 
Navy (including most of the RPT graduates) felt that RPT was well worth 
the time and effort; objectively, the evaluation findings werp incon- 
clusive. 

Academic Remedial Training in the Present 

The Navy's current excursion into literacy training appears to have 
been brought about by*the Army's manpower supply problems during the#Vletnam 
conflict. During the Vietnam buildup, the Army was forced to accept personnel 
wlio were classified as marginal by their scores on *the Armed Forces Qualifi- 
cation Test (AFQT). Generally, these volunteers and draftees ranked in the 
10th-30th percentile range on the AFQT (Project One Hundred Thousand, 1969). 
As a consequence of its manpower needs, the Army indicated to the Department* 
of Defense that a cohere^nt program for processing marginal personnel was 
needed if manpower requirements were to continue being met. Defense re- 
sponded in Octobet 1966, %y establishing "Project 100,000," which was to 
help meet manpower supply problems by spreading marginal personnel throughout, 
all three services. The project was also intended to provide training for 
these men so- thatr rhey would be betted" prfep'at^d XO t'etiirn W clVillah life ' 
if they chose to do so. Under Project 100,000, the Navy agreed to accept 
up to 15 percent of its enlistees froBi the marginal category and allow them 
to volunteer for the normal draft toiir of 2 years. Accordingly, the Navy 
established RPT units at Great Lakes, Illinois, and San Diego, California, 
in February 1967 (Weeden, 1975). Almost immediately, the name of the program 
%#aa changed to Academic Remedial Training (ART), and this is the name current! 
in uflA. 

Despite the expiration of Project 100,000 In 1972, the ART program 
has continued in operation up to the present. Although projections have 
indicated that induction of marginal personnel will be unnecessary even 
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under the current no-draft policy (e.g., Battelle, Brown, Kruzie, Marshall, 
Moll, Paskert, & Radovich, 1973), ART may be continued because of the rising 
national consciousness concerning equal employment opportunity and/or because 
of (anticipated) Improvements in the national economy. 

*•■' C. .... * ** 

A student may currently be selected fot ,ART if he averages between 
3.0 and 5.5 grade levels' on the Vocabulary and Comprehension Sections of the 
Gates-MacGinitie Reading Test. Originally, the Navy Life series was once 
more dusted off and reedited for the program; however, use of these materials 
was largely discontinued in 1969. As described by Weeden (1975), t}^ course 
of instruction may last a maklmum of 8 Veeks and is bi^oken into. two phases: 
a diagnostic phase and a therapeutic phase. The diagnostic phase provides 
for initial assignment of t*e student '^to on? of three courses: 

''^'l. Course Mike — a phonics course emphasizing word attack skills. 

2. Course Oscar — a reading course beginning at the 3.0 grade 

level. 

3. Course Victor— ^a reading course beginning at the A.O grade 
level. ' • 

The therapeutic phase consists of two mutually reinforcing areas: word 
attack and reading abilities. The word attack area concerns phonics, 
vocabulary development, and word knowledge (root words, inflections, pre- 
fixes, synonyms, etc.). ^The reading abilities area concet^is reading practice, 
comprehension ^skills, and study skills. ^ • 

Notably, ART is integrated gnly into recruit training as were RPT 
and the Special Training Program before it. ^ The proportion of ^.literates 
in the United States in 1960 was estimated to be only 2.4 percent (Uarman, 
1970)4 and, %rith current screening practices, it seems unlikely that there 
is an appreciable number of illiterates assigned to Navy hlllets. However, 
a new concern that keys on the concept of functional llt^eracy is beginning 
to appear^ It may well be that, despite the universal attainment of literacy 
by Navy personnel some men (^nd women) m^y fall to perform because they do 
not read w%ll eqpugh to meet the requirements of their jobs; there Hiay, in 
effect, exist a literacy gap. This possibility was first raised by the Fattu 
and Standlee report of 1954; however, two Reports by Carver (1973a, 1973b) 
and current work by Duffy at the Navy Personnel Research and Development 
Center seem to support the current concern over a literacy gap. If such a 
gap exists it may become necessary to extend literacy training from the 
recruit commands to the fleet. The nature and location of programs devised 
to meet the literacy gap would represent very new directions in the history 
of literacy training in the Navy. 

Final Comment 

From the preceding survey o% literacy training, it is apparent that 
"problems of literacy are not a recent discovery; they have been a concern 
of the Navy throughout its history. This concern has been motivated both 
by a need for proficient job performance and by an Interest in the general 
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welfare of Navy personnel. In the development of literacy programs, the 
Navy has, at one time. or another, been sensitive to at least the following 
six Issues: 

1. Level of Literacy . Efforts have been made to Identify levels of 
literacy and to tailor Instruction to the level required of a trainee. The 
idea of functional literacy as a consideration In determining what level , 
of literacy a trainee ought to achieve In order to perform a specific job 
has also appeared, 

* 

2, ' Cause of Literacy Problems . Adjustments In Navy progranJb have been 
made to Identify speakers from nonstandard English llqgulstlc communities 
and to adjust Instruction based on the language habits likely ^to be fostered 
by those communities. 
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3. Evaluation. Both najrro^ (Are program objectives being met?) and 
broad (Is Fleet performance being enhanced?) Issues have been considered 
In evaluating Navy literacy traln%ig. 

4. Decoding . Issues of relating orthography to acoustic representa- 
tion so' that learners may Identify Information within their linguistic 
experience have been addressed. / 

5. Affect . Learner's -attitudes toward themselves and toward literacy 
have been taken Into account. 

6. Active Participation . Most military training attempts to Involve 
as much "hands-on" experience as possible and this approach appears In Navy- 
literacy training, particularly with the emphasis On the Navy Life workbooks^ 

On the othef< hand, the Navy's Interest In literacy has been largely % 
intermittent. From the evangelical concern of the chaplains to the current 
Interest In , ART, lack of literacy skills on the part of Nays personnel Is 
always given full opportunity to handicap the Navy's operational effectiveness 
before anything Is done about It. Programs that are devised In response 
to literacy problems usually prove to be relatively sophisticated as the 
Special Training Program and RPT currlculums demonstrate, but these pro- 
grams seem to appear only In response to wars or other national emergencies.' 
The outlook for the current ART program cannot be very bright. ART Is 
remarkable for continuing as long as it has aft^ the demise of Project 
100,000, but It seems reasonable to anticipate waning Interest In ART on 
the part of the Navy- unless (1) probleM arising" from the all-vplunteer 
^ military suddenly become more severe, (2) manpower supply, for whatever ^ 
reason, becomes more constrained, or» (3) th6^ national priorities for equal 
employment opportunities are sustained. 

The primary haipe for continued Interest In literacy training seems 
to rest on the concept of functlpnal literacy In which the concern is not 
so much with Illiteracy as with what literacy Is necessary for specific 
/^Navy jobs (e.g., Duffy, Carter, Fletcher, & Aiken, 1975). In this respect. 
It seems likely that concerns of literacy will be modified in two ways. 
First, they will becooie more narrow In that finding and applying technical 
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information will be emphasized rather than more ge%^ral skills of reading ^ 
and writing. Second, these concerns will become more broad in that con- 
siderations of medl£(, such as the organization and quality of technical 
manuals, the availability and capacity of systems for computer-based In- 
formation retrieval, and the comprehenslbllity and usability of graphic 
and^pictorial information, will be integrated with more conventional y 
lltferacy considerations. These are fairly novel directives for literacy 
training in the Navy, but they are also timely. It Is difficult to come 
away from an historical survey of literacy training without an appreciation 
for tiie continuing Increases in the amount of information that .must be 
available for successful performance of Navy Jobs. Classically exponential, 
these increases were at first gradual but are now accelerating at an 
Imprj^ssive rate. The Importance, and even urgency, for systematic concern 
with literacy is hard to escape, and it is to be hoped that literacy training 
wlli receive continuing support from all the military services. * 

References ' ^ - - 

# 

Battelle, R. B. , Brown, H. D., Kruzle, P. G., Marshall, T. H., Moll, K. D. , 
Paskert, P. F.^ & Radovic, M. Analysis of some potential manpower policies 
ipr the all-volunteer Navy . Menlo Park, CA: Stanford Research Institute, 
June 1973. 

Bloomfleld,. L., & Barnhart, C. L. Let's read; A linguistic approach . * 
Detroit, MI: Wayne State University Press, 1961^ 

^Burr, H. L. Education In the early Navv . Doctoral dissertation. Temple 
University. Philadelphia^ PA: Published by the author, 1939. c 

Carver, R. P. Measuring the^ reading ability levels of Navy personnel . 
Washington, D. C%: iteierican Institutes for Research, October 1973. (a) 

Carver, R. P. Measuring the reading difficulty level%of Navy tralnl<ig^ 
manuals . Washington, D. C: American Institutes for Research, Octpber 
1973. (b) X 

Cofer, C. N. Adjustment to recruit training: A study of the effects of * ,^ 
recruit preparatory training (Technical Bulletin 5A-Z2). Washington, D. C. : 
Bureau of Naval Personnel,' Personnel Analysis Division, December 1954. 

Couch, P. E. Educatiohal emphasis In civilian conservation camps of the . 
Seventh Corps area . Unpublished doctoral dissertation, Indiana 
University, 19AA. - - 

Cummlngs, D. E. Enlisted training In the Navy. United 5tatfes Naval Institute 
Procecfdlngs . 1929, 55, 878-886. 

Curriculum for Recruit Preparatory Training . Washington, D. C. : Bureau 
of Naval Personnel, Personnel Analysis Division, April 1953. 

Drury, C. M. The history of the Chaplain Corps United States Navv . 
Washington, D. C: (Sovernment Printing Office, 19A9. 



31 

25 



Duffy, T. M. , Carter, J. C, Fletcher, J. D., & Aiken, E. G. Language 
skills; A research and' development plan for th^ Naval service (Special 
Report ifa-^^)* San Diego, CA: ^ Navy Personnel Res4&rch and Development 
Center, October 1975. • 

Fattu, N. A., Fay, L. C, D*Amlco^, Ln A,, & Standlee, L. S. Observations 
on Navy literacy training (MemorandTum Repot t) • Washington, D. C«: 
Bureau of Naval Personnel, Personnel ^^lysls Division, March 1934. 

Fattu, N. A., Mech, E.,*& Standlee, L. S. A review of literacy training 
programs In the armed services during World War II (Technical Bulletin, 
33--4)*« Washington, D. C. : Bureau of Naval Personnel, Personnel AnaClysis 
Division, December 1953. , 

Fattu, N. A. , & Standlee, L. S. Analysis of reading difficulty of selected \ 
Navy. materials (Technical Bulletin 54-3). Washington, D. C. ; Bureau of 
Naval Personnel, Personnel Analysis Division, March 1954. 

Fullam, W. F. The Petty Officer's Drill Book. United States Navy . Annapolis 
United States Naval Institute, 191^2. 



Ginzberg, E. , & Bray, D. W. The tineducated . New York, NY: Columbia 



Fullam, W. F. The Recruit's Han&y Book . Annapolis, MD: United States 
Naval Institute, 1902. 

' I 

University Press, 1953. q 

Uagen, E. P.., & Thorndike, R. L. A study of the World War II Navy careers 
^ of illiterates sent through literacy training (Res. Rep., Contract 
NONR-644(00)) . Washington, D. C: Bureau of Naval Personnel, Classifica- 
tion and Survey Research Branch, April ^953. 

Harman, D. Illiteriacy: An overview. Harvard Educational Review , 1970, 
40, 226-243. 

Harrod, F. S. . Enlisted men in the United States ^Navy 1899-1939 . Unpublished 
doctoral dissertation. Northwestern Univeirsity, June 1973. 

Heath, S. R. , Jr. The teaching of reading in a military setting. The 
Training Bulletin . 1946, 43, 150-156. \ 

Hodges, C. I. Special training programs (Unpublished Report). Washington,* 
D. C: Bureau of Naval Personnel, November 1964> 

Langley, H. D. Social reform in the United States Navy^ 1798-1862 . Urbana, 
ILL: University of Illinois Press, 1967. 

Luce*, S. B. The manning of a Navy and mercantile marine. United States 
Naval Institute Proceedings , 1874, 1^, 17-37. 

Luce, §. B. Naval training. United States Naval Institute Proceedings. 
IMO. 16, 367-430. , 

32 

26 



McLean, R. Blualacket's Manual . Annapolfs, MD: United States Naval 
Institute, jL992. 

Niblack, A. The enlistment, training, and organization of crews for 
our new shiptf. United States Naval Institute Proceedings . 1891, 17 . 
3-A9. ' ' • 

Potter, F. U. A school for bluejackets. Outlook, 1913, 114, 694-705. 

Potter, F. H. , A repair shop for men. Outlook, 1918, 120. 539-540. 

Project one hu^adred thotisand; Characteristics and performance of "new 
standards" m^n . Washington, D.'C: Departmq^nt of Defense, Manpower 
and Reserve i|lf fairs, March 1969. 

Ross, C. S. Literacy training in the Navy. School and Sotietv. 1946, 
63, 203-204. 

Special training program (Unpublished Report). Washington, D. C: 
Bureau of Naval Personnel, 1951*. * 

Standlee, li. S. A follow-up comparison of three groups of Navy enlisted 
men; Marjginal-and- illiterate, marginal-but-literatifc and typical recruits 
(Technical Bulletin 54-20). Washington, D. C: Bureau of Naval Personnel, 
Personnel Analysis Division, July 1954. 

Standlee, L.- S., Fflltttu, N. A., & Auble, J. D. Data on dally performance 
of marginai.-and-'ljll iterate. mar£inal-but-literate^ and typical recruits 
frcm threel naval training centers (Menorandua Report). Washingtim, D. C: 
Bureau of Naval Personnel, Personnel Analysis Division, July 1954. (a) 

1, 

Standlee, L. S., Fattu, N. A., & Auble, J. D. Frequency- index of words 

appearing in four Navy publications ^(technical Bulletin 54-2). Washington, 

* D. C. : Bureau of Naval Personnel, Personnel Analysis Division, January 
1954. (b) \ 

Veeden, E. T. Academic remedial training (Unpublished Report). San Diego, 

• CA: Naval Training Center, January 1975. 



V, 



33 

f 



LITERACY TRAINING IN THE 
\ T. M; Duffy 



Literacy research In the Na^vy today has had two major objectives. 
First, there hAve been efforts to characterize the literacy "problem" 
In the Navy and thereby provide^ a data base foi^ evaluating alternative 
approaches to Insuring that a literacy ^deficit at any level does not / 
hamper the effectiveness of the servlceT^The full range of reading; • 
levels has been examined and basic demographic data on reading and Its^ 
relationship to other abilities and to background characteristics h^e 
been provided. This research has also Involved an examination of tat 
relationship of reading skill to job perfdrmance. The second major li.ne 
of research has focused on the Navy's current approach to deficient ijlteracy 
skills — reading training programs, for personnel with i^arglnal. readlt 
ability. ' This research has Involved evaluations of the effectiveness 
of the training programs, tests of new Instructional methods* and pre 
cedures for predicting the successful readitig training stude^tl 
examining this literacy research In detail, I vould like to bff:4.'ef ly chat- 
acterlze the Navy's objectives vls-a-vls literacy and the options av^4j.able 
In meeting these objectives. This characterization will pnov^^ ^^^^ 
an understanding of the Navy's current re-emphasis on literacy: anoTV ^ 
framework for many of the questions addressed in the research ^forl 

The Marine Corps currently provides basic skill training In readi 
at both of their recruit training centers for all recruits reading b^ 
the 4.5 reading grade level (RGL). For the Navy, reading trali^lng ^ 
provided at the three Recruit Training Centers for ^IJL recruitB^ havi ^ 
a tested RGL between 3.0 and 5.5. Ig^Fiscal Year (f^f^if9:i^^^ M^ 
5.1 percent of the Navy recruit population, or 4,50(ijmen, had ^reading skills 
in this range. Recruits below a 4.0 RGL are consldifeTM poor tafoftiidfi^eck^ 
for the short-term reading training and are typically discharged fvoBi^ a 
the service, while recruits above a 5.5 RGL are considered to have adf^k^^te 
readlng^kllls. Although the reading programs focus*op personnel vij^ 
marginal capabilities, the objectives of the programs and tV^Servld^s - 
objectives In* literacy are more generally stated. These obji^tftlves are: 
(1) to provide a level of literacy skill to all personnel ^^o as to Insure 
Fleet effectiveness and Fleet safety, and (2) 'to provide ^L^ l^:^^f^<^y 
skills necessary for equal opportunity In attaining upward\o|^i^^y and 
a successful career (Stewart, 1974; Academic Remedial Training, x975). 
itbceiit studies by Carver (1973b, 1973c) have raised the question as to 
whether either of these objectives Is attainable within the structure 
of the* current reading training programs. ' Carver compared the reading 
requirements of a sample of 20 Navy 'training manuals to the reading ability 
of a sample of 271 recruits. The manuals required, on the average^ a 
lAth grade readlng^blllty and ranged -from 9th to 20th grade as measured 
by several readability formulas. In ^ontrast^ (he average reading ability 
of the recruits was only 9th grade. t 
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Carver's results Indicated a. major- gap between the reading require- 
ments and the reading abilities In the Navy. Additionally, they suggest 
that literacy training to the 5.5 RGL is less than adequate for meeting 
thes literacy demands In the service. Regarding the objectives of literacy 
training, a 5.5 RGL would seem to neither Insure Fleet safety and effective 
ness nor to provide the opportunity for upward mobility. To meet these 
objectives will clearly require a reduction in the difficulty of manuals. 
In addition, personnel decisions with regard to literacy will be required. 
The options here Include: (1) an expanded reading training program, ^ 
(2) assignment to job areas with reading requirements matching reading 
ability, (3) selection into the service of only thosV men having adequate 
reading skills, or (4) some combination of the above. (See Duffy, Fletcher 
Carter & Aiken, 1975; arid Stlcht, 1975b for further discussion of these - 
options.) 

While discussion of these options was underway,^ few basic data 
were available upon which to bkse decisions. The distribution of reding 
levels in the Navy was unknown,^ and thus the number of men affectad and 
the cost Involved in -any of the options could not be determined. The 
literacy requirements in the various occupational areas were similarly 
unknown and thus a determination of which men an expanded literaq^ program 
should address and where in the career such a program should be located 
could not be made. Indeed, the very need for literacy training could 
t^ot be assessed. Two arguments against the need for literacy training 
of any sort have been advanced. First, the move of the Service toward 
accepting only high school graduates has been proposed as an action which 
will also eliminate low-literate personAel. Second, it has been suggested 
that most equipment and vocabulary knowledge is acquired on the job and, 
therefore, with job experience a man will be able to read the necessary 
manuals. The^ argtnnent continues that* the inexperienced man, regardless 
of his reading ability, receives his instruction orally from his super- 
visor and, thus, his job does not require reading. An examination of 
the relationship of reading ability to education and to job performance 
would provide the data necessary to assess these arguments. 

Reading Skill and Its Relationship to Other Perstonnel Characteristics 

In 1974 a group of us at the Center began a research effort to charac- 
terize reading skills in the Navy and thus provide a data base to answer 
some of the questions described above. The program was a joint effort 
with the Naval Training Center and Recruit Training Command in San Diego 
and had as an additional goal the early identification of all recruits 
eligible for the San Diego reading program. We have now collected reading 
and other ability data as well as performay:e data on approximately 30,000 
recruits and on 1500. men receiving occupational (*'A" School) training. 



'^Chlef of Naval Operations (OP-099) speedletter 991B/550 of 3/13/74, 
Readability Level of Publications and Adult Basic Skill Training. 

^The distribution and variability of reading scores was not available 
from the Carver (1973b) data. . , V 
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Method 



' Recruit Sample and Readmg Test . All recnilts entering recruit 
graining at San Diego from May 1974 to May 1975 we«p administered the 
(iates-MacGlnltle Reading Test, Survey D (Gates & MacGlnltle, 'i965) . Only 
th| vocabulary and comprehension subtests were admlhlste^d. The vocabu- 
lary subtest consists of 50 multiple choice Items and requires synonym 
matching. The comprehension subtest Involves a modified cloze procedure 
(Taylor, 1957) In which words are deleted from paragraphs and the subject 
selects the proper word from several alternatives. The test l^^^Wfcted 
at 4th and 6th grade readers. But la j^iiq>lrlcally normed on stud^&^ In 
the 3rd through 9th grades. The test was adminlsterd during the first 
week of training, a processing weeic during which clothes, etc., aye Issued 
and standard Navy tests are admihls|ered. Testing was done In groups 
of 50 to 70 men (by recruit companies). 

During our testing {i^rlod, 32,890 men were processed at San Diego. 
Of thla total, 96 percent, or 31,540 men, were administered reading tests. 
In examining the- relationship of reading scores to standard Havy test 
scores, the sample was reduced to 28,542 or 86.7 percent of the total 
Input. The reduction In sample size Is due to a variety of factors, but 
of primary Importance were the discharge or hospitalization of men at 
the time of testing and the Incorrect recording of Identifiers at the 
time of testing, which resulted In an Inability to natch a man's recprds 
at the time of data analysis. The data analyses did not always involve 
the entire sample, but In all" cases the sample used Involved all of the 
men processed In a specified time frame. 

"A" School Sample and Reading Test . Men from the "A" Schools 
at the San Diego Training Center were represented In this sample. The 
"A" School Is the first specialized training a man receives after recruit 
training. Approximately 70 percent of Navy recruits attend one of the 
50 or more "A" Schools. « The San Dleg0 schools in our sample ranged from 
clerical to electronics training.^ Testing occurred ^In the classrooii 
at each school during class. Men were tested from April to September 1975. 
The sample yas doubled in four of the short-duration schools so as to 
have equivalent time frames for the samples. At present we only have 
data available on six schools, involving a total of 564 men. 

The Nelson-Denny Reading Test (Nelson & Denny, 1960) was adminis- 
tered to the "A" School sample. Again, the vocabulary and"^ comprehension 
subsections were used. The vocabulary test is similar to the Gates- 
MacGlnitie. The comprehension test involves reading paragraphs and an- 
swering fact\and inferential questions about the content. This test is 
directed at che 9th to 16th grade reader and is empirically normed on 
students in grades 4 through 16. 



^The schools were: Ship's Serviceman, Hull Technician, Mess Specialist, 
Interior Communications, Electricians Mate, Basic Electronics & Electricity, 
Quartermaster, Machinery Repair, Data Processing, Signalman, and Radioman. 
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Othier Test ancj^Personnel Data , All of the "A" School sample and 
1294 recAlts were also tested on the Na\^ Pattern Matching (PM) t«st 
of nonverbal ability. The PM was derivi^, f rom the Raven's Standard Prp- 
gressive Matrices Test (Raven, 1958), which ^is generally considered to 
be a culture-free test of nonverbal intellectual ability (Jensen, 1972; 
Carver, 1973a; Spearman, 1946). The derivation of the P^t involved an 
item analyses of the Progressive Matrices in which low frequency item 
alternatives and non-discriminating iteins were eliminacad. The test 
involves 38 multiple-choice items with five alternativesS per item. 
Norming on a sample of 500 Navy recruits yielded a mean of 28.8 and 
standard deviation of 5.3. ^ * 

For koth the recruit and "A" School samples, we obtained all of 
the test anA background data collected as a <Jiormal part .of processing 
into the service. These data include: / 

1. General Classification Test (GCT) — a test of general ability 
involving verbal analogy and sentence completion items. ^ 

2. Arithmetic Reasoning Test (ARI) — a test of mathematical ability ^ 
involving word problems. ^, 

3. Mechanical Ability (MECH) — a low-verbal test of knowledge^ of 
mechanical principles. 

Clerical Test (CLER) — a speeded digit search test requiring 
nonverbal skill. 

5. Electronics Test (ETST) — a verbal test of electronics 
aptitiide. 

6. Shop Practices Test (SHOP) — a test of tool knowledge requiring 
the matching of a picture of a tool to verbal descripitions of uses. 

7. Armed Forcfs Qualification Test (AFQT) — a score derived from 
the GCT, ARI, MECH, and CLER by their regression on the former AFQT test of 
general ability, which was administered throughout the Armed Forces. 



8. Years of Education — self reported. 

9. Race — obtained only for the recruit sample. 

Results ^ • 

Reading Levels . Figure 1 presehts» the distribution of reading 
levels in the recruit sample. The mean score of 9.8 compares favorably 
with the mean of 9.3 obtained by Carver (1973c) . However, because of 
the skewness, the median score of 10.7 is more reflective of the general 
reading ability. The skewness of the distribution reflects the lim^ta-* 
tion of the Gates-MacGinitie test (which has a maximum score of 
for this sample. -;i 
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The median RGL of 10.7 Is generally reflective of the education 
level In our sample, where 70.9 percent left school after rtther the 11th 
or 12th grade. However, as Indicated in Figure 1, a significant number 
of recruits have reading skills balow the high school level. Oifie method 
of determining the sighifiqance of these^^reading levels iB- to compare 
the reading ability of the men to tl^e reading demands they face ^fi the 
Navy. In this regard we analyzed the readability of those manuals ^nd 
tests which most recruits are ^expected to read and comprehend. «The 
materials were analyzed using the FORCAST formula (Caylor, Sticht, Fox, & 
Ford, 197j), which^was developed on Army men and materials ^nd relates 
the proportions of one-syllable words to the reading ability required 
for comprehension. The materials assessed and their reading difficulty 
were: Xhe Bluejackets' Manual (11.5 ROL) , which is the baslc'manUal in 
boot camp; the Airman (10.5), Fireman (;10.2) and Seaman (10.2) rate 
training manuals used during and right after completing boot camp; tlm 
General <:iassification Test (10.8) and Arithmetic Reasoning Test (9.0;, 
which are administered in the process of plassifying recruits. A compari- 
son of these readability levels with the reading* skills of jrecruits in- 
dicates a rea'^sonable match between the average difficulty level of material 
and the average skill level. However, the materials we aissessed are 
materials all Navy recruits are. expected to read and comprehend. Viewed 
in^his way, the data indicate that approximately half of the recruits 
have a reading deficiency relative to their job-reading demands. Further, 
the deficiency amounts to a grade level deficit of 2.5 or mbre years for 
18 percent of the recruits. . . 

In the development' of readability formulas, the baseline or norming 
material is read only once and comprehension ^verbatim or inferential) 
pf all of the material is assessed. Thus, in interpreting the difficulty 
level of material as assessed by a readability formula there is an impli(^it 
assumption that the manual is- read only once and that all (^f the material 
is equally relevant. This is clearly not the case; the material is 
frequevitly read several times and is supplemented by oral instruction. 
Thus the apparent "lititacy gap" as indicated by a comparison of reading 
levels and readability is most likely larger than the actual "literacy 
gap." 

Regardless of the exactness of our detern|ination of reading require 
ments, our ability data indicate that significant^portions of Navy per- 
t sonnel will have difficulty comprehending typical Navy written materialiB* 
If it is necessary for these low ability men to comprehend general Navy 
printed materials, instructions, safety information, and perhaps technical 
information, then their effectiveness in the service should be reduced. 
(Evidence to be^presented later indicates that reading skill is indeed 
related to performance.) For example, l.Svpercent of the recruits, or 
1600 men (based on FY 1974 recruit figures), read below the 4th grade 
level. . These ;!ijgiOv cannot decode the printed word and by national standards 
are considered functionally illiterate. Clearly, these men will not be 
able to read any job or. safety material. The 4th to 8th grade reader- 
is able to decode print bift is dei^cient in vocabulary skill, in the 
ability to infer from and^ interrelate printed information, and in reading 
speed. In our recruit |||imple 18 percent, or a projected 15,800 men, 
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entered the "Navy last year with reading skills below the 8th grade level. 
These nen may be expected to conprehend most Navy material if th^ can 
reread the material and are assisted by other personnel. Hovevert the 
efficiency pf their job performance will be Impaired and at a marginally 
acceptable level. If these men are required to act In an ea^rgency In 
any way that requires the use of printed material » they may veil prove 
a hazard to effective Navy operations. 

A minimum of 70 percent of recruits go on to "A*' School training* 
so there Is considerable overlap In the recruit and "A" School populations 
While the primary purpose of the *'A" School assessment was to examine 
the role of reading In school perfomance* the reading levels are of 
Interest theawelves since they provide a more complete picture of reading 
skills In the Navy and the options for assuring adequate skill levels. 
For example, the presence or absence of substantial numbers of low skill 
readers In the "A" Schools has Implications for classification policies 
as well as the location ^nd nature of read ln||^t raining programs. 

The Nelson-Denny reading test was usedwn assessing the "A" School 
sample* since It provides norms for higher levefs of reading skill.** The 
mean and median RGLs In this sample were 11.1 and 11.2* respectively. 
Even though the "A" School personnel are selected on the basis of abllltyt 
we find that 9.6 percent of the sample had reading skills below the 8th 
g/ade level. Table 1 presents a more detailed examination of the reading 
iJbvels In each of six "A" Schools as well as an Indication of the reading 
requirements (readability) In those schools. 

The readability score is for the rate training manuali which Is 
studied for advancement to the 3rd and 2nd class rates. The manual Is 
used in the "A" School claftsro^ and the rate exam Is typically taken 
irlthln foiir months of compl'erHig the school. The data in Table 1 indicate 
that ft)r all but the Ship's Serviceman, the mean reading ability of the 
men appr^lmates and In some cases exceeds the mean reading difficulty 
of the manual. However, In three of the six schools a significant pro- 
portion of the men are low-ablllty readers and may be expected to face 
reading difficulties. Even In those ratings where the proportion of low 
ability readers Is small, the actual number of men» several hunSlred per 
rating based on FY 1974 manning figures* Is conslderab^. 



**Data on 188 men who appeared In both samples Indicate that the 
Nelson-Denny and Gates-MacGlnltle tests yield similar data. The median 
reading ability for these men was 11.5 on the Gates as compared to 12.5 
on the Nelson-Denny.* The correlation of the two test scores was .65, 
which Is a strong correlation when one considers that half of the men 
In the sample fell between the 11.5 and 12.0 RGL on the Gates-MacGlnlt les 



test. 
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•Table \ 



Reading Grade Levels (RGL) of Men and Reading Grade Level Requirements 
For Manuals in Each of SJ^ Navy Occupational Training "A" Schools 



Men Manuals 







X Below 




School 




8.0 RGL 


X RGL** 


Hull Maintenance Technician 


10.2 


19.12 


10.7 " 


Ship's Serviceman 


10. A 


18 • IZ jitak 


12.9 


Mess Specialist 


10.6 


12.03^ 


ld.2 


Quartermaster 


11.7 


iM 


10.9 


Interior Comnuni cat ions 


11.9 


5.1Z 


12.6 


Electricians Mate >. 


12.0 


2.32 


12.7 



^RGL for men is based on Nelson- Denny reading test performance. Means 
and medians were comparable in each school. 



Readability scores are taken from Biersner (1975) and are based on the 
application of the Flesch Reading Ease formula normed on Navy men and manua 
(Kincaid et al., 1975). 

All of Our assessment data indicate that the options available 
in approaching literacy deficits in the Navy will affect significant 
numbers of personnel. For example, if a 5*5 RGL, the current reading 
level deemed necessary in the Navy, were required for admission into the 
service, 9 percent, or 7800, of the FY 1974 recruit population would 
have been rejected. Eighteen ^rcent of the recruits, or 15,800 annually, 
%iould be eligible for a literacy program expanded to an 8.0 RGL t«||pinal 
criterion, a criterion which only approaches the initial reading demands 
in the service. The same number of men would be affected by the imple- 
mentation of limited duty aBsignments for below 8th grade readers. The 
coAts involved nnd the number of men affected by implementation of nny 
of these optionfl demand that the options be carefully considered. 

Our findings with regard to literacy skill levels in the Navy 
indicate that one or more of the above options must be implemented to 
assure effective performance levels in the service. These options, 
however, must/' necessarily focus on the very low literate man in order 
•to be manageable and within reasonable cost figures. The distribution 
of reading skills in the '*A" Schools suggests an additional option which 
would address personnel with less severe literacy deficits. This option 
involves a literacy training program for personnel deficient in reading 
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Hkllls but qualified for "A" School. The program would have as a cri- 
terion the ability demands of each school and would provide functional 
reading training preparatory to, or in conjunction with^ school graining ^ 
The major benefit of this program is that it would provide the opportunities 
of upward mobility and career flexibility for men who, while eligible 
for "A" School training, are likely to perform at a marginal level. 
Additionally, the program would involve fewer personnel and hence would 
be more manageable than a broad-based literacy program. Finally, the 
program would address specifiable Navy reading requirements. HumRRO, 
under contract to the Center, is currently evaluating J;he^o8t effective- 
ness and management considerations involved in this and otner literacy 
training options, 

r 

I^ducation . One of the suggestions discussed earlier was that 
the move toward accepting only high school graduates would reduce or 
eliminate the marginally literate personnel. Our data indicate , to the 
contrary, that a high school diploma bears little relationship to reading 
skills of personnel currently in the service. As can be seen In Figure 
2, the median reading level for men with at least a high school diploma 
is less than 1 RGL higher than that of the non-high school graduates (the 
medians are 10.9 and 10.2 respectively). While proportionately fewer 
high school graduates fall below an 8th grade RGL,. this proportion (14.9 
percent), nonetheless, indicates that the selection of only high school 
graduates would still produce a significant number of marginally skilled 
individuals . 

F^urther analysis on a sub-sample of 19^000 recruits indicates 
that years of education, ranging from 8th to 16th grade, only correlates 
.13 with reading ability. Of a41 of trhe test and background information 
for which we have data, years of education shows the least relationship 
to reading. This finding may be contrasted with previous research which 
has found years of "^education to be the most valid predictor of attrition 
from the service (Flag & Hardacore, 1964) and delinquency (Gi^nderson & 
Ballard, undated). One might conclude from these data that a high school 
diploma indicates a persoa's willingness to conform to the rules of 
society rather than his ability. However, a more likely explanation is 
that over recent years the" predictive power of years of education has been 
reduced due to the increasing proportion of high school graduates entering 
the Navy. Tims, the small correlation we obtained is likely due to the 
reduced variance in years of education as well as the reduction in the 
number of personnel wit!) very low education levels and reading skills 
rather than to any clmnge In the basic relationship between reading and 
education. Indeed, recent evaluations of adult reading skills in the 
United States indicate that education, in this population, is predictive 
of reading ability. In studies -by NorthCutt, Selz, Shelton, N]|cr, Hickok, 
and Humble (197S0 and Young and Jamison (1975) a reading test was admin- 
istered to a. large, representative sample 6l U. S. adults. In both studies, 
education level was the demographic variable which most strongly predicted 
reading skill. Thus, the Navy's current policy in rejecting most appli- 
cants with little education also tends to elimifUlite the poor readers. 
However, the data in Figure 2 Indicate that any further restrictions in 
educational Requirements wou||l have little effect on the reading skill 
levels in tfte Navy. 
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" Race , Figure 3 presents the distribution of reading scores for 
each of the three major race categories at tjie San Diego Recruit Training 
Center (RTC). Aproxiroately 1^5 WSLs separate the median scores of the 
groups, with Caucasians havitg the 'highest median (11.0) and Malaysians 
the lowest (7.6). The same ranking' races is obtained when one compares 
the proportion of men reading below the 8th grade level. However, in terms 
of , absolute numbers the men with lower reading skills at the San Diego 
RTC are primarily Caucasiws and Malaysians. 

The race data suggest a major cause of many of the reading problems 
for men at; the San Diego RTC. The Malaysians, while representing only 
8.6 percent of t?lie recruit population, constitute 28.0 percent of the popu- 
lation of below 8th grade readers. The Malaysians also constitute a group 
in which English Is a second language for most men. Although English 
is taught beginning in the "Ist grade in the Malaysian countries, its use 
Is restricted almost entirely to the school and is limited to "formal 
English.** Thus, a deficiency in functional reading skills may be expected. ^ 

The relationship of reading skill and racial category indicate 
tliat any policy of selection or classification on the Isasis of reading 
skills would have definite affects on the racial distribution in the Navy. 
The data also indicate tha^t any reading training program will haye to 
have tlie capability of dealing with skill deficiencies cliaracterizing 
personnel wl^h English as a second language as well as personnel with 
English as a native language but who have* failed to develop adequate 
reading skills. 

Ability Tests . One of our primary interests in the ability test 
data .was to determine the degree to which reading ability could be pre- 
dicted from performance on standard Navy tests. Our testing program was 
limited to San Diego and was due to terminate in March of 1974. A con- 
tinued tracking of reading levels in the Navy, continued estimation of 
the number of lov-abillty readers, and estimation of reading levels at 
the other RTCs would be possible if a strong relationship weiTe obtained 
between reading and (he Basic Battery Tests. 



^The race data are not necessarily representative of the Orlando and 
Great Lakes RTCs since the lar^e proportion of Malaysians at^San Diego is 
due to Its geographical location. However, considerations of English as a 
second language may apply to the segment o^ Spanish speaking people found 
at those training commands. 
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Figure 3. Rfidlng leve)^ mtjor race citegoriet at RTC, Sin Diego, May-Aug 1974. 
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Data from the first 7135 recruits taking the reading testi were 
used in the initial analysis. All Basic Test Battery scores were entered 
as prediction variables into a stepwise multiple regression analysis with 
the Gates-'MacGinitie reading score as the dependent variable. The GCT, 
a highly verbal general ability test, was found to be the best predictor 
of reading, r • .73 and standard error - 1.36 RGL. The clerical test 
entered next Into the regression equation but added only .006 points 
to the multiple correlation. Thus the prediction of reading is loost 
. efficiently based on GCT alone. These findings are similar to the 
reading — general aptitude correlations of .68 and .82 obtained in the 
Army and Air Force respectively (Caylor et al., 1973; Madden & Tupes, 
1966). The degree of relationship is to be expected since their g^neifal 9 
aptitude tests, like the Navy's GCT, tend to be highly verbal tests. 

The empirically determined RGL as well as the predicted RGL for ^ 
each level of GCT is presented in Figure 4. The empirical relationship 
is linear in the midranges, but both a basement and ceiling effect are ^ 
evident. The celling effect is due to the limitation of the reading test, 
while the basement effect is likely due to a IfuflTot sensitivity of the 
I GCT at the low end since the GCT was designed to predict school success 
\ rather than to discriminate between low ability personnel. The validity 
of the regression of GCT onto reading was checked using a sample of 
4517 recruits. This sample consisted Oi^ all recruits entering RTC San 
Diego during the two-month period following the initial sample. The 
cross-validity coefficient for reading and GCT dropped to .64 with a 
standard error of 1.6. The reason for the magnitude of this decrease 
in relationship is uncleaf , but it would seem to be partly a chaQce fluc- 
tuation since additional analyses Involving GCT and reading in other re- 
cruit samples have yielded correlation ranging from .69 to .80. In any 
case, comparing the standard error of estimate obtained on the initial 
and cross-validation samples indicates that the decrease in correlation 
should not seriously affect the accuracy in pr^icting the general levels 
of reading ability in the service. 

The results of these analyses indicate that GCT can be used to 
track changes in reading skills in the Navy's accessions. In addition, 
GCT can be used to obtain an approximation of proportion of recruits 
falling into gross categories of reading skill. However, GCT cannot be 
used to discriminate between low ability readers. At best, the results 
indicate that 95 percent of those recruits reading below the 6th grade 
level will h ave a CtCT which is at I'enst one half of a standard deviation 
below the mean (less than a A5 GCT). Ift the future we will be comparing 
this regression equation with one derived fr^ the Nelson-Denny test in 
our "A" School sample. 
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In addition to these regression analyses, we are currently using 
the data base provided by the ability tests to evaluate various hypotheses 
cpncerning the relationship of reading ability and nonverbal intelligence. 
The hypotheses derive primarily from the proposals by Sticht (1972, 1975a), 
Jensen (1972) and others that reading ability is built upon nonverbal 
intellectual ability and that asymptotic reading performance^ is« determined 
by this basic ability. We have the Pattern Matching test as a measure 
of nonverbal intelligence. In addition to this measure we will be examining' 
factor loadings obtained in a principle component factor analysis of all 
our test data. As a part of this effort we will examine the contributions 
of verbal skill and intellectual ability to performance on Xhe individual 
tests in the Basic Battery. 



Reading Ability and Navy Effectiveness 




A basic assumption underlying the interest* in literacy in the services 
and the very occurrence of this conferen^ is that reading ability is 
a significant factor in determining the effectiveness of a serviceman's 
Job performance. Job performance refers to the performance of those xl^ties 
associated with a position at any phase, including training, in a man!s 
career. Logical arguments relating reading ability to job performance 
have been presented by Duffy et al.* (1975) and Sticht (1975b). However, 
the conceptual and measurement difficulties Involved have hindered attempts 
to evaluate the assumption. ^Conceptually, reading is viewed as an essential 
skill. It Is one of the broad enabling skills which provide the means 
for acquiring specif ic knowledge and ability. Reading skill .wil] 
a role in determining, the acquisition of. specific knowledge on tht 
or in training as well as. the specific abilities brought into the seFJ^eT 
Because reading is so' intimately related to the acquisition of specific 
knowledge, it is difficult to define the point at which a man's success 
or failure at a task is due to his specific achievement level in, for 
example, electronics, tather t^ian his reading skill level. While reading 
is integral to the development of more specif skills, the development 
of reading, in turn, requires a general intellectual ability. Conceptually, 
general ability sets the"^ upper limit for the de^^elopment of reading skills 
(Sticht, 1975b). However, the independent measurement of reading and 
general ability has proven immensely diffioult, as witness the still vexing 
problem of obtaining a truly nonverbal measure of intelligence (Singer, 
1973). 

Not only are the interrelationships of reading with other ability 
variables complex, but the eventual analysis of these relationships is 
further hindered by our inability to directly manipulate an individual's 
reading ability. That is, ^ere is no program available to experimentally 
raise or lower an individual's reading skill by four or five grade levels, 
so that the effect of a change in reading can be evaluated. Rather, we 
must rely on correlational analyses where the performance of good and 
poor readers is compared. Unfortunately, the poor reader will 9lso tend 
to hp the individual with both low general ability and few specific skills. 
Thus the direct causal effect of reading on Job performance is extremely 
diffic?ult to extract. 
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Another measurement problem lies In the nature of the Indices of job 
perf brmance. * Performance measures frequently tend Co be restricted in 
. rapp,e to scdres around that point defined as "adequate." Because of this 
test? £|,tlph In range, the magnitude of the correlation of a variable with 
siich^ pfer'formahce measure will be reduced. Additionally, the considera- 
tions involved In judging performance vary from person to person and sit- 
^uatloti to sltuatrbn resulting in questionable reliability. In illustration 
or^thle difficulty. Stitch, ^^^^^k^^ll^ and Fox (1971) found correlations 
ranging from .13 to .24 hetwe^^^^k^f^s actual ability to do a job and 
his supervisor's rating of his'^'^ISibility . Since the supervisor's rating 
Is the typical on-the-job perfMtoance measure, there is baslcally.no reason 
to expect any greater correlaWon between reading and such a measure. 
Recruit training success is another job performance ^measure in which 
Individual judgment and a variety of considerations are involved. How- 
ever, school training performance, based on test scores, may be expected 
to be more reliable.. 

The preceding, rather pessimistic present5*^ion of the difficulties 
encountered in attempting to define the role of reading in Job performance 
Is meant to emphasize the fact that correlational data alone cannot pro- 
vide the necessary Information. Most correlational evidence in this area 
can be viewed as supporting or rejecting the role of reading, depending 
on whljch of the many complex, mitigating factors are emphasized. The 
correlational analyses can be used to determine whether a reading test 
would be a useful addition to a selection battery or a job/school classi- 
flcatlpn battery. In this case the interest is in performance on a reading 
test as a predictor of job performance regardless of the direct causal 
role. If any, of reading ability. However, the correlational analyses 
only serve as one data source for inferring the importance of reading 
In one job area relative to another job area. For example, if reading 
test perfomiance correlated .50 with electronics technician performance 
but only .20 with machinist mate performance, this would suggest that 
reading Is relatively more Important in the former area. However, it 
Is still necessary to examine the reading requirements and skill levels 
represented In the two areas. We need to know if large amounts of reading 
are expected of the men and If there is a gap between the difficulty of 
the material and the ability of some reasonable portion of the men. This 
exercise mu3t be performed for all job areas since a low correlation of 
reading and perfomiance may simply reflect the unreliability of the job 
performance measure In that area. Once all ciata sources are evaluated. 
Inferences may be made as to the relative role of reading in- a job area. 
However, tlie causal effect of reading can only be firmly demonstrated 
by evaluating the effects of simplifying reading material or training 
the rcailing skills of personnel. 

l'r(»vlniis efforts to examine the readlpg and Job performance relation- 
ship have b(en limited to personnel with very low reading abilities (fisher, 
1971; Ilagen & Thorndike, 1953; Holberg, Hysham & Berry, 1974; Standlee, 
1954). Inferences regarding the role of reading In these studies is tenu- 
ous at best since the "good" readers are still significantly deficient 
In reading relative to potential job reading requirements. To adequately 
assess the importance of reading, some portion of the sample must exceed 
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a skill threshoid which approximates the level required on the job. 
In addition to this difficulty, some of the studies inferred, rather 
than measured, the reading skills of the "good" readers. For example, 
Hoiberg et al. (1974) compared Navy recruits who had been assigned to 
remedial reading (poor readers) to a group with equivalent general ability, 
but not assigned to the program (good readers). Reading scores were 
only available for the poor readers. The comparison group was assumed 
to have adequate reading skills because they were not assigned to remedial 
reading. However, at the time of the study the reading skills of an 
individual were only assessed if he faip.ed the first test in recruit 
training. Then, even if a man had a reading deficit he was only assigned 
to Mmedial reading if space permitted. Given these conditions and the 
equation of the groups on general ability, there is simply no assurance 
th^t the group differed in reading skill. 

r ' ' 

Our recruit and "A" School samples provid^Tthe opportunity to examine 
the relationship of performance on a reading test and job performance 
where the full range of reading skills is directly assessed and repre- 
sented. Our performance measures are "A" School performance scores and 
attrition from recruit tr>aining. Prediction of these perfonwince measures 
has been the subject of considerable research since they are fundamental 
considerations in the selection and classification of personnel. Thus 
our data, in addition to providing basic information on the role of reading 
in the Navy, are^ relevant to considerations of tlie uQe of a reading test 
in the selecticni and classification of personnel. The focus in the analyses 
is on the contribution cxf reading test performance to job performance 
relative to those measures already in use. ^ , . 

Method 

Recruit Sample . The sample of tecruits for this analysis consisted 
of 20,627 men entering RTC San Diego between 1 June 1974 and 1 February 
1975. The dependent variable was attrition from recruit training. The ^ 
attrition lists at RTC San Diego were checked monthly and all attritees 
for whom we had reading data were noted along with the reasons for attri- 
tion. The predictor variables were: 

1. Odds for Effectiveness (OFE) . An estimate of the probability 
of completing the first tour in the service and being recommended for 
reenlistment. This is an actuarial table used by recruiters in which 

a composite score is derived from years of schooling, expulsions and 
suspensions from school, and Armed Forces Qualification Test Score (Flag, 
1968). 

2. . Armed Forces Qualif ici^tion Test (AFQT) . A score derived from 
performance on the GCT, ARI, and MECH tests taken at the recruit station. 
Placement into a mental category is based on this score. 

3. Reading Ability . Performance on the Gates-MacGinitie reading 

test. 
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/ "A" School Sample , ' The "A" School sample and the predictor vari- 

ables are as described in the previous section. The dependent measure 
for this portion of the project was average performance on a weeTcly paper 
and pencil test. Subsequent analyses will examine an "in school" job 
performance measure as well as the final score in the- school, which is 
a score based on all previous testing. * 

Results 

Attrition . In our total sample of recxSuits, there was a 7.7 percent 
attrition rate, compared to an actual attritioi rate at San Diego of ' 
approximately 10 percent during our test pericJa. This disparity reflects 
the attrition of personnel prior to administration of the reading test 
as well as personnel who were hospitalized at the time of testing and 
eventually attrited. The distribution of reading ability for the afetrj-tees 
and nonattritees in our total sample is shown in Figure 5, The^|;;|iroarv 
reasons for attrition in our sample were inaptitude (academic and militlkry) , 
physical disability, and psychological disability. Approximately 30 percent 
of the attritees were in each of these three categories. Even with this 
wide variability in the Reason for attritiori, the d^ta in Figure 5 indicate 
very different distributions of reading skills for attritees and nonattritees 
(median reading levels are 8.2 and 10.9 respectively). The^'Vprobability 
6f attrition in each of the reading categories is shown in Table 2. A 
clear and systematic relationship between reading ability and th^ prob- 
ability of attrition is evident. The less than 4th grade readers have 
a .36 probability of making it through boot camp, while the probability 
is .96 that the above 10th graders will make it. 

While reading test performance is clearly related to attrition, 
the question s^till remains as to the contribution it makes relative to 
other available indices. It may be the case, for example., that the reading*^ 
attrition relation is dependent upon covariations with general ability. 
If so, reading and AFQT scores should be equally effective in predicting 
attrition. To answer this question, we entered the reading, OFE, AFQT, 
and years of education scores into a stepwise multiple regression analysis 
with attrition, a dichotomous variable, as the dependent measure. The 
sample of recruits was divided into subsamples of 15,500 and 6300 for ^ 
purposes of cross-validation. The multiple regression analysis of the 
initial sample yielded reading as the strongest. predictor of attrition, 
r " .25. The addition of the remaining three predictor variables added 
only .02 to the multiple correlation. The reading-attrition relationship 
increased, to r = .33 in the cross-validation sample, and here the remaining 
three variables added only .003 to R. The independent correlations of 
OFF, AFQT, and years of education with attrition in the initial sample 
were .19, .17, and .14, respectively. The comparable correlations in 
the cross-validation sample were .16, .18, and .12. / 
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Table 2 

San Diego Attrition Rate Uithln Readifig Categories: 
June 1974 - Jafuary 1975 



Reading Grade Levels 



1 



<4 4.0-5.9 tjO-7.^, 8.0-9.9 



526 I 1^24 2500 ' 

337 290 257 
64.1Z 20.4: 10.3Z 



10.0-12.0 



Total 



4129 I 14i261 22,840\ 
299 603 1,786 

7.2: 4.2: * 7.8i: 
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The attrition analyses thus far Indicate that attrition rate sys- 
tematically decreases as reading test performance Increases, and this i 
hQlds for the full range of reading levels. Additionally, of the vari- 
ables examined, reading Is the single best predictor of attrition within 
the current recruit population. It may be, however, that the contribution 
of reading In the prediction of attrition may be almost totally accounted 
for by t*e' covariation In the AFQT, OFE, and education variables. To 
determine the Independent contribution of reading performance ^o the pre- 
diction of attrition, l,e,, the contribution of reading over and above 
the other Independent variables, a second, step-wise regression analysis 
was performed. This time, howeven, OFE, AFQT, and years of education # 
were. entered into the analysis before reading. These three variables 
together yielded a multiple correlation with attrition of ,.20, The 
addition of reading as a predictor raised this correlation to ,30, 
Thus, reading performance contributes meaningfully to the prediction of 
attrition Independently of the other predictor variables. 

That ^attrition was more strongly correlated with reading performance 
than with the other Independent^arlables should not be Interpreted to 
indicate that reading ^performance is a more valid or important?^ndlcator 
of attrition. The recruits we testecj^had already been selected into the 
service on the basis of their OFE, AFQ^, and education scores. Thus there 
is greater attenuation in the range of these scores than in reading scores 
and a smaller correlation Is to be expected, ^However, reading performance 
clearly adds to the prediction of attrition and, therefore, the addition 
of a reading test to the selection battery would serve to reduce attrition 
rates. 



The data further Indicate that the reading, ability of an individual 
is CO some extent an essentia skill in boot camp. That is, the fact 
that reading test performance contributed to the prediction of attrition 
Independently of AFQT suggests that it is reading skill per se and not 
a general ability factor, underlying reading test performance which is 
related to attrition. The data in Table 2 IndltiJEifce that a reading ability 
of approximately the 7th grade level is necessary for achieving success. 
This relatively low level is consistent with^^the reading requirements 
in boot camp. That is, recruit training is ytlmarlly a pi^ceae of ac- 
culturation. While reading of rather difficult material Qlth grade level 
on the average) is required, this consmnSs only a portion of recruit 
training and all of the reading material is fully discussed in a classroom. 
Thus it is reasonable to assume* that only basic .readlhg skills are required 
to attend to routine forma* etc,, and to review material presei^ted in ^ 
class. 



"A" School Performance , Only a preliminary analysis of the^rrl^.'* 
tionship of each of our predictor variables to weekly test perfonnfanc^ - t 
has been completed. In this analysis we were again Interested npt only ^ - 
in the degree of relationship of reading and performance, but also in how,- v." 
that relationship compared to the largest correlation betwe^ one of th^ ^ 
current predictor tes6s and performance. The data relevant to these> / 
considerations is presented in Table 3— -reading-perfoiTnance correlational ^" 
range from ,20 to ,50 across the six schools, while the maximum predictor 
test correlation with performance ranges from .21 to ,61, 
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Table 3 



Correlation of Reading, Pattern Matching, and the Most 
Predictive Test in the Basic Test Battery (BTB) Wlth^ Weekly 
Test Average In Six Navy "A" Schools 



Weekly Test Average Correlation With: 

School , 



Hull Maintenance Technician^ 
Shlp'B Serviceman 
Mess Specialis;t: . ^ • - 

Quartermasf er ^ /. ^ 

Interior Communications //'i 
El^c tr Iclaii * Mat e 





Pattern 


- BTB , 


Reading 


Matching 


Test 


.20 


.22 


.21 (ARI) 


.26 


.16 


.21 (ARI) 


1 .43 


.22 


.32 (ARI) 


. .SO- . . 


.A8 


.61 (EST) 


* .39' " 


. >. -.39 


.50 (ARI) 


V23 




.4A (ETST). 



\- \^A weekly tgs'^t is iiot- administered in this- school and therefore the 



^''^^l^y* test k^esige score w$8 used. 




i- We assux^e th|it the yaria(^lllty acrosfs schpol»^ef lects not only 

variability 1# scolding crUtei^a bu-t also variability In, the reading levels 
]rbprc8ented, rjelatlve . amount o^ j^adlng required, anH reading, difficulty 
of the raatertal.'. attempt Xo *f Irid spm^ pattM^' In these relation- 

ships we compared the^^C*5rrelationa.l patte^rn in TalJle 3 to tlie pattern 
of reading le^^ls ^iidj. reading difficulty found In the schools (Jable 1). 
This eompari$dti) indicates that rhe reading difficulty of th^' materials 
no rel^tiohship 'tto either the abWlut^e or rel^iye effectiveness' 
rcad^fng as ^^pr edict o^t of schobl'^aerformnce. , However, ^reading is 
3und Db be the. best perr9rman^||. predict^or ii« the sakne three schools which 
ive*the larg^t propoVtiu>n of low abt^i^y |-eaders (S^^p^s Serviceman, 
nil Techplodfan^- and cdnparisor\ (bf the variability 

;V of rendipjg scor^ps; ili^»lj^a%& thaC\ the schpols^ are comparable ^vC this respect 
^ (standardvdeyfa<lon8 range from 1V9 to^/.l) ^nd^ thus t^hc; relationships 
1 obtained are not due to^a > stati-st^lkl anopaly. » . 

" The'flfoding' that reading ±B/yi more*' effective, predictor of per- 

fonnance, rJlative^ to other^redicj^or tests, in schools hip^fing a large 
proport^ion cH<i-ow abill^ty- readers Is. not "ilourprlslng. The results do 
suggest, 'jiffM^'Ar I .that pLndtyidual dl^erences in readii\g levels are most 
lmpdrtanfciiW9&ic lower 'r&nges of reading i^illty. • SlroiJ&rly, a reading 

*«abilltt^^eAdln'g difficulty ihismatch iavles^.. Important At the higher levels 
of rea^j^^^and 'readability, l^rc detailed ^ata^^halyses and inclusion 

i_^of the rant^inlng five Schools are tie^K^AT to verify th^se clearly post 
hoc^^lndlngiL' These analyses will include multiple regressions in which 



reading and the current predictor of success In a school (some combination 
of Basic Battery tests) will be evaluated 'as predictors of performance* 
If the tj^tatlve conclusions we have drawn are verified, they suggest 
that lower ability readers (the specification of "lower ability" to be 
defined In future analyses) are poor risks In the "A" Schools. Therefore, 
a reading test would serve as a useful classification Instrument or, 
alternatively, an "A" School preparatot^ reading program as discussed 
previously could be Instituted to provide the- deficient readers with the 
necessary skills. 

Literacy Training v . ' \. 

I would like now to narrow^the focus of consideration to personnel 
demonstrating major deficits in reading skills — the below 6th grade 
reader. ,As discussed In the Introduction, the Naval service provides 
reading training for low literate personnel at all the boot camps. I 
will first discuss three of these programs and the evaluation data avall^ 
able. In addition, I will describe three experimental training 'programs 
which have Just been Initiated. Finally, I will d escribe my own research 
efforts to characterize the reading deficiencies and to predict the prob- 
ability of success In the current training programs. 

Current Programs ^ 

W The three programs to be described are Navy programs In San Diego, 

California and Orlando, Florida, and a Marine Corps program In San Diego. 
The Orlando program was an experimental effort to test the Individualized 
Learning for Adults package developed by Research for Better Schools (RBS 
Program). This is ^ self-paced program for Illiterate adults and provides 
training material to the 9th grade level. Training was on general literacy 
and focused ^on the specif Ic^ skills of recognition of sound. symbol relations 
(phonics), word attack (vocabulary), comprehension , (literal and interpre- 
tive) and study methods. There are 129 performance objectives ^n the 
program, with 32 of the objectives devoted to decoding skills, 21 to word 
attack, and 41 to comprehension skills. Five entrance tests were used 
to determine the appropriate starting level for an individual and per«^ 
formance during training wais regulaifly assessed using 70 different pre«- 
and posttests. The training materials were 129 study booklets and 54 
audio cassettes especially prepared for this program. The maximum 
student-instructor ratio was 7 to 1 instructors and a maximum of 28 \ 
students in .a classroom). « The instructors were Navy men selected on the ^ 
basis of having a college degree (area of study unsp/scif led) . Instruc- 
tional time ranged from 10 to 160 houts with a mean of 60 hours. 



^Program descriptions and evaluation data were lobtained from the 
fallowing sources: Marine Corps (Stewart, 1974; 1975); Navy in San Diego 
(Academic Remedial Training, 1975); Navy in Orlando (Research for Better 
Schools, 1974). 
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A total of 43 male recruits parfliplpated in the RBS program between 
September 1973 and February 1974. The criterion for selection .was a r 
score of 7,0 RGL on the combined vocabulary and comprehension subtests 
of the Gates-MacGinitie Reading Survey D, The methods of selecting re- 
cruits to test was not specified. After three weeks in the program, the 
student was retested on an alternate form of the Gates-MacGinltie test. 
If this score exceeded a 7,0 RGL the man was returned to recruit training, 
otherwise he continued through the entire RBS program.^ 

The Marine Corps (MC) program in San Diego was devised especially 
for the Marines in conjunction with the local adult school. This is 
the only program involving civilian instructors, all of whom are female 
and hold teaching credentials and adult school certificates.. The pro- 
gram involves some self-pacing but is classroom based and fixed at four 
weeks (120 hours) of instruction. The training is in general literacy, ^ 
and instructional time, according to the program syllabus, is distributed 
as follows: decoding (phonics), 40 percent; reading speed and compre4 / 
hension, 42 percent; vocabulary development (sight vocabulary and word^su-^ 
attack), 15 percent. Thus there appears to be a greater emphasis on de- 
coding skills in this program than in the RBS program where 25 percent 
of the objectives deal with decoding. A vide variety of commercially 
available training materials and diagnostic tests are used in the program, 
including the Controlled Reading Skill Development Series (Educational 
Development Lab), McCall-Crabbs series (Columbia University), Reading 
Attainment System (Grolier Educational Corp.), Reading for Understanding 
(Science- Research Associates), and Phonic Word Blend Flip Charts (Kenworthy 
Educational Service) . 

All recruits at the Marine Corps Recruit Depot In San Diego who 
read below the 4.5 grade level are accepted into the MC program. Initial 
screening is accomplished through the administration of the Gates-MacGinitie 
Reading Survey D to all recruits scoring below approximately the 70th 
percentile op the general classification test. Recruits scoring below 
the 4.5 RGL are retested on an alternate form of the Gates-MacGinitie 
and only if they once again score less than a 4.5 RGL are they admitted 
to the program. The sco^re on the second test serves as the person's 
entrance score. Evaluation dataware available on 492 recruits entering 
the program between February 1974 and July 1975. 

The Navy program in San Diego (NSD program) is the only prograan 
of the three under discussion which is run entirely by the service. 
Instructors are Navy personnel having a college degree and the training 
materials are selected or developed by these instructors. Approximately 
25 percent to 30 percent is devoted to phonics training. The phonics 



^The fact that a student was not retested until 3 weeks into the pro« 
gram appears inconsistent with the report that some men completed the 
program In 10 hours. No explanation is available. 
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materials are based on the Motts Phonic System (unreferenced) and are 
similar to tho^ used In the MC program except that phonics Is concentrated 
In the first week of training. Successive weeks of the program deal with 
vocabulary (60 words per week), comprehension, and reading speed. The 
program Is lock step and Is a minimum of 3 weeks. Failure In any week 
results In repeating that week. Thus, the program averages 4 weeks (92 

' hours) and ranges from 3 to 6 weeks. Beginning In July of 1974 (FY 1975) 
specific testing for knowledge of sound-symbol relations was Instituted* 
If skills In this area were adequate, then the recruit bypassed the first 
week. Thus, In FY 1975 the average program duration was reduced to 
somewhat less* than three weeks (69 hours) with a range of two to five 

' weeks. 

The training materials are a mixture of Instructor-generated work- 
sheets and commercially available supplemental materials. Hardware is 
» limited to reading pacing devices. Prior to FY 1975 the supplemental 
materials consisted of the McCall-Crabbs readers and a few magazines 
(e.g.. Scholastic Magazine). In FY 1975 a wide variety of commercially 
available training packages, books, and magazines were Introduced into ^ 
the program. It is estimated that in both FYs 1974 and 1975 approx — 
Imately 70 percent of the vocabulary training material and more than 
90 percent of the comprehension training material focused on general 
literacy.^ 

The NSD program is directed at recruits with an RGL between 3.0^ 
and 5.5. Prior to FY 1975 a^l recruits falling the first academic test 
in recruit training were administered the Gates-MacGinltle Reading Survey . 
D. If a recruit scored below the 3.0 level he was recommended for dis- 
charge. Recruits between a 3.0 and 5.5 RGL were admitted to the NSD 
program. In FY 1975 the Gates-MacGlnltle reading test was administered 
to all recruits. Those scoring less than S.5 RGL were then retested on 
an alternat^ form. Only those scoring between 3.0 and 5.5 RGL on the 
retest were admitted into the program. 

» 

The distinction between FY 1975 and FY 1974 procedures Is important 
in the consideration of the effectiveness of the program. The RBS progranf 
and the NSD program prior to FY 1975 admitted students on the basis of 
a single terft administration. Since only low scoring individuals were 
admitted into ^he program and later retested, the change scores should 
y be subject to considerable upward regression. The HC program and the 

FY 1975 NSD program, by selecting students after two test failures, should 
reduce this regression effect. Thus, the regression effect should artl- 
factually Increase the amount of gain in the FY 1974 NSD and RBS programs 
to a greater degree than in the other two programs. 



^The NSD program is currently undergoing another revision. The new 
materials are estimated to be 70 percent to 80 percent Navy and the instruc- 
tion will be individually paced. 
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In addition to the program characteristics described thus far, 
differences in student characteristics and program policy may be ex- 
pected to affect gains in reading within the programs • Tables A and 5 
summarize the educational and racial characteristics of recruits entering 
each of the, programs. The racial distribution is about equivalent in 
the MC and iNSD programs except for an increase in the proportion of 
Filipinos (and thus second language training requirements) in the FY 1975 
NSD program. Educational differences, however, are considerable. Approxi- 
mately 50 percent of the NSD students have a high school diploma while 
only 20 percent of the students in the other programs are gr^duat4s. 
If a higher level of educational achievement is indicative of better 
developed study skills, then the NSD programs may s^ow greater reading 
gains simply due to the relatively greater level of educational achieve- 
ment of their students. Parenthetically, it is interesting to note that 
the data in Table 5 reflect the conclusion drawn earlier that a high school 
diploma does not insure that a person is functionally literate. 
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Table 4 



f 


Percent of Recruits in Each Racial Category 
Four Reading Training Programs 

» 


for 








Race 




Program 


Caucasian 


Black 


Malaysians 


Others 


RBS^ . 










MC 


45 


29 


16 . 


20 


FY7A NSD 


AA 


26 


• 12 


18 


FY75 NSD 


AO 


20 


26 


14 



a 

RAce cj3ta unavailable for this^chool, 
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Jable 5 

Percent of Recruit^^t Each Level of Education For 
Four Reacftg Training Programs 









Education Level 






Program 


8 


9 


10 


11 


12+ 


RRS 


7 


16 


26 


30 


2lf 


MC 


12 


22 


• 26 


26 


19 


FY74 NSD 


2 


12 


16 


25 


45 


FY75 NSD 


3 


6 


. 15 


23 
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Table 6, while summarizing Instructional gains In the programs, 
also contains Information relevant to our consideration of the relative 
gains one night predict /for the programs. First, the entry level reading 
scores at MC are considerably below thosi^ In the other programs.. The 
values were ti^ot subjected to statistical' coiq>arlson because of the lack 
of adequate raw data and because of the widely varying "n's." However, 
the entry scores fall within that range of ability at which phonic skills 
arfe acquired. Thus .a 1 RGL difference In entry levels should reflect 
a meaningful difference In phonic skills, which ^e considered by instruc- 
tors as the most difficult and time-consuming skills to acquire. In a 
post hoc vein, our own data and data from the MC and NSD programs indicate 
that entry reading level is a good predictor of amount of *galn (a positive 
relationship). Therefore, on the basis of entry level scores the MC 
program should' yield smaller gains. Table 7 also indicates that the NSD 
programs attrlte a considerably greater proportion of students. Since 
only graduates are entered into the posttest calculation, this greater 
attrition should artlfactually Increase the gain in reading skills found 
in the NSD programs. 

Table 7 sunmarlzes those program characteristics which might be 
expected to benefit the amount of gain found in each program. The RBS 
program may be character^lzed as "program" oriented since it involved 
carefully developed training Materials and procedures. The MC program, 
in contract, capitalizes dn Instructor capabilities and extended contact 
with j^e Instructors (a relatively long training period). Finally, 
the^SD program benefits are student based in that better students (higher 
RGL and level of education) enter the program and there is a more liberal 
policy of attrltlng students not Showing progress or students deraor\8trat- 
ing Improper attitudes. 
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Jable 6 



Mean Reading Grade Lev^l on. Pre- and Posttests, 
Gain In Reading, and Attrition Rate for Four Reading Programs 



1 


Reading Scores 




Attrition 

A. 


•a-'* 


f 

Pretest 


Posttest 


Gain 




RBS* (N-43) 




6.3 


1.8 


.00 


MC (N-490) 


3.5 

* 


5.7 


2.2 


.10 


FY74 NSD (N-785) 


4.2 


6.0 


1.8 


.2? 










FY75 NSD CN-658) 


4i2 


6.1 / 


1.9 


.24 



Note.' Reading was assessed on the vocalbulary and^omprehension 
subtests of the Gates-MacGinitie Reading Survey D. 

*The does not reflect' attrition ^Mr, the prbgrama. 
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Table 7 

Program Characteristic^ Which Are Expected to Result 
In Relatively Greater Reported Qains in Reading 



Program 



Characteristics 

♦ 


RBS 


MC 


Fy74 
NSD 


. FY75 
NSD 


Greater Instructor Qualifications 




X 






Longer Program Duration 




X 


X 




Greater Training Materials 
Expenditure 


X 


r 






Greater Individualization 


X 








Higher Ent*ry Reading Levels 


X 




X 


X 


Higher Education Levels 






X 


X 


Higher Rate of Attrition 
From Pre- to Post test 






X 


X 


Greater Statistical Regiression 
From Pre- to Post test 


X 




X 





4* 
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The gain scores as well as the posttest scores presented In/Tabl^ 
7 Indicate that despite considerable differences In program orltotatlon, 
all of the programs yield approximately the sane amount of gain and terminal 
level of reading performance. Potentially, training of some of the men 
In the RRS program was terminated after 3 weeks due to achieving a 7.1 
R'GL or hlghex; on a test. However, all other men as well as the men In 
the other 3 programs were required to complete a fixed course of Instruc- 
tion. Additionally, In all programs, except perhaps the FY 1974 NSD 
program, training materials went well beyond the 6th grade level. Thus 
the similarity between programs In the final level of achlevemdnt does 
not seem to be due to a- celling ^effect created by a comnonallty In training 
criteria. The difference between the programs In terms of amount of gain 
Is only »4 RGL. Considering' the substantial differences In character- 
istics between the programs, this small a d;lfference In effectlveneiss 
suggests that within the confines of a short duration. Instructor based, ^ 
low literacy program, the amount of instructional gain in general llteraby ^ 
is fixed a^d determined by the simple exposure to the educational settlM T 
This conclusion is further supported by the 1.2 RGL gain in general literacy 
obtained in the Army's Functional Literacy Training program (Stlcht, Caylor, 
Fox, Hawke, James, Snyder, & Kern, 1973). This prbgram, which imderwent 
considerable experimental development, employs qiiftlified teachers, is 
highly individualized, and focuses on functional reading skills. . None« 
theless, it possesses the defining characteristics for my conclusion and . 
the gain in general literacy is colinparable to the gains obtained in the 
Naval service. 

Results obtained by' Shennum, Aiken, and Thomas (1975) suggest 
that this invar lance in reading gains may even apply to specific instruc- 
tional procedures. These* investigators examined three procedures for 
increasing reading speed for recruits in the fl-nal week' of the FV 1975 
NSD program^ with the hypothesis that excessively slow reading speeds (fre- 
quently found in these programs) may be an Important contributor to poor 
comprehension. The training method of primary Interest Involved slmul:- 
taneous reading and listening with the rate controlled through a variable 
rate speech compressor. Comparison conditions were: (1) simply listening 
to the compressed speech; (2) reading with no listening but with rate 
goals specified and feedback given. Recruits in these conditions spent 
2 hours per day for six days reading a 40,000 word novel written at the 
8th grade level. A pretest-postteat evaluation using different materials 
indicated tjiat each condition produced an Increase in reading rate of 
about 60 words per minute and a 20 percent increase in comprehension » 
These gains, while constant across conditions, were nonetheless due to 
training since a nd^treatment control showed no gain in rate or compre- 
hension over:^the^-day period. 

The general conclusion I have drawn from these evaluations should 
not lead to the assumption that literacy training programs catinot be 
Improved. A consideration of alternative criteria for training success 
(the criteria are currently the Amount of gain and the exit level in 
general literacy), a shift to training of men with less deficiency, or 
the introduction of refresher or retraining programs may all y±e!^d jootb^^^ 
effective reading programs. . J^rhaps the most Important consideration^ ^ 
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18 a rethinking of the criteria for training success. In most Navy training, 
program effectiveness Isjheavlly weighted by the time required to reach 
a criterion. The « time fi^tor Is very important since students and staff 
are ail on salary. If a time criterion were applied to the reading pro- 
grams, then Individualized, computer-based programs employing mastery 
learning techniques probably would be by far the most cost effective 
(Aoklnson, 1972; Ball & Jamison, 1973; Bloom, 1974). The only time 
inxormation available on the present programs comes from RBS, where it 
was found that, on the average, 41 hours of instruction were required 
for a one-year gain In reading.' However, that one-year gain required 
52 hours of Instruction for recruits without decoding skills, but only 
25 hours when recruits could decode. 

The criterion for literacy training should also be rathought In 
terms of the ultimate goals of the program. The goal is notSto produce 
more literate men but rather to give each man the skills necessary to 
effectively perform the reading tasks required of him in the service* 
These skills Involve* ah ability to readily find information in manuals, 
ro read and comprehend *procedural directions and instructions, to deter- 
mine the relative fmportance of Information on a system, etc. The vo- 
cabulafy requirements and the reading strategy required in these tasks 
differ considerably from the rMuirements In general literacy. Tests 
based on service-relevant reading material and tasks will very likely 
show program gains not reflected In general literacy tests. 

Still related to the ultimate criterion of Increased Navy effective- 
ness, a program addressing men with minor reading deficiencies may be 
expected to yield greater gains In performance effectiveness as compared 
to low-literate programs even If both programs produced the same gain 
In the same time. While the advantages of the former program were dis- 
cussed earlier, no Information was available on the relationship of reading 
lillt>rovement to entry-reading, level. Data derived from these literacy 
programs Indicate that, In addition to the gains In Navy effectiveness, 
a program for moderately literate men would require less training time 
to achieve the same gains In reading. The NSD personnel refuse to accept 
less than 3,0 RfrL readers as they have found training of these men to 
bt> virtually Impossible. RBS reports that when a man Is not proficient 
In phonic skills he requires twice as much '"'"ij tjMte to produce a year 
gain In reading. In my work at NSD I h^vpMStd a strong linear 
relationship between entry level and gain (r iflP^and .59 In two samples 
of native Fngllsh speakers). 

Literacy training programs 4iave frequently been criticized for 
the tendency to be one-shot programs. Clearly meaningful permanent gains 
In reading cannot be expected In a three-week program. Exercising of 
the new skllls^nd refreslier training are necessary. The NSD personnel 
retestcd 58 g^^aates from the FY 1975 program 2 to 7 weeks after gradua- 
tion. The delay' between the final test and retest did not produce any 
systematic differences In change scores, which Indicates that the loss 
duo to termination of training occurs within ♦two weeks. The average 
graduation score* for these 58 men was 6.3 RGL while the average retest 
score was 5.1, a 1.2 RGL loss In reading skill due to the termination 
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of training. If these men were representative of the FY 1975 input ^ffto 
the program, these data indicate a .9 RGL permanent gain from the entry 
reading level of 4.2 RGL.^ However, this gain is still subject so some 
regression effect and so the permanent gain in the program is likely a 
.5 to .8 RGL. While retest data is not Available on the other Navy pro- 
grams there is no reason to suspect the permanent gain would be any greater 
than that obtained at NSD. The exit reading score indicates that t^e 

men have the capability of reading aboveuthe level attained in retesting. 

To achieve that higher level on a permanWit basis, however, will require 

mini-refresher courses over an extended time frame. 

That the reading programs produce approximately equivalent gains 
and that there is considerable loss in skill after a man leaves the program 
should not detract from their relative effectiveness. The pretest and 
posttest gain of approximately 2 years in these compulsory and time- 
compressed programs is indeed significant. Looking at the gain$ in another 
way, the men, on the average, ranked at the 30th percentile for 5th grade 
students at entry into training, while on the posttest, the men were at 
the 69th percentile. Thus, during the course of approximately four weeks 
of , raining, these men move from the lower to the upper third of the 
distribution for this particular reference group. The 2 RGL gain is also 
significant relative to an average .5 RGL gain achieved in civilian adult 
school programs of the same total instructional hours but spread over 
five iiy)nths (and therefore providing distributed practice) and offered 
on a voluntary basis (Kent, 1973). Similarly, experimental reading pro- 
grams for scho^^l children at the same re^j^fig skill level as the recruits 
have produced less than a year gain in a year of instruction (Battelle 
Institute, 1972). In comparison, the Naval service programs have proved 
exceedingly effective in improving reading skills. My discussion, instead, 
addresses whether more effective programs can be developed and whether 
the programs produce gains to the service beyond the increase in reading.^ 

With regard to the effects of the reading programs on later Navy 
effectiveness, graduates of the NSD and MC programs have been tracked 
<j|>rough boot camp to determine their rate of attrition. The success 
of a sample of 301 MC program graduates was assessed 3 tiO 1,4 months after 
graduation. The attrition rate of this sample was 12 percent, compared 
to an overall boot camp attrition rate of 10 percent. Since boot c^ytip 
is only 11 weeks, these data indicate that graduates of the MC program 
have an attrition rate equivalent to or less than the Marine Corps average. 
Additionally, only 33 percent of the graduates were judged to have a 
promotion rate slower than normal, while for 17 percent the rate was judged 
to br faster than normal. Unfortunately, an untrained sample is not 
available for comparlst)n purposes. (P^rhap®, iBost.»«|o^re typically judjg^d 
to be progressing^faster than normaU) The data ^^^pj^gest thatAthe MC 
program graduates^'are progressing through the s^»*!a.t a normal rate. 
However, we do not know to what degftee reading dtrlllty is predictive of 
performance in the Marine Corps (it is evident th^t .the reading require- >V 
merits are less than in the Navy). Thus the "ftorm^" performance of these 
graduates may be due to some characteristic of the^reading program or / 
it may be due to the lack of any relationship between reading ability V ' 
and servic# ef f ec t Iveness. * ; * ^ 
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IJoot camp attrition rate for a sample of 387 graduates from the 
FY 1974 NSD program was 12 percent. This can be compared to an average 
10 percent attrition rate at the boot camp and an attrition rate of 18.7 
percent for 4th and 6th grade readers. As with the MC program, the graduates 
of tl»e NSD program appear to perform as well as the average recruit. Here, 
however, we have data pointing- to a relatively strong relationship between 
reading and attrition (see Table 2) and thus the 12 percent attrition 
rate for graduates appears to be significant. 

m 

The graduates of both the MC and NSI) reading programs appear to 
be performil^R as average recruits. However, a basic question is whether 
their level of performance in the service is due to the improved skil^ 
level and attitude obtained from the reading fwrogram. While a definitive 
answer to this question Is no||^ possible, it seems highly unlikely that 
a 1.0 RGL Increase In ability would substantially affect the performance 
level of a functionally illiterate recruit. A more likely effect of 
tlie programs is that they serve to filter out recruits having low capa- 
bility for learning or having a poor attitiKie. These people are repre- 
sented in tlie 12 percent and 14 percent attrition rates In tlie MC and 
FY 1974 NSD programs, respectively. Thr only way we are going to be able 
to adequately assess the effectiveness of reading training on Later service 
^ef f ectiveness is through an adequate experimental design In which only 
a portion (randomly selected) of the personnel eligible for reading 
training are actually assigned to the program and the program resulted 
in meaningful gains in reading skill. A judgment of reading tiklning 
effectiveness would then be based on attrition rates from the point of 
assignment, ratlier than examining only the graduates of the reading 
program. 

i; xperimental Reading Programs ^ ^ 

In addition to the ongoing programs for recruits there ate three 
experimental programs under Navy sponsorship. Since these programs are 
only in tlie initial stages of development, I will only briefly describe 
tliem. Researchers at NAVPERSRAI>JnCEN are devAoping programs for training 
plionlc or decoding and vocabulary skills in the low-fjifre^te recruit. 
Tlie training is computer based and has as dual goals the evaluation of 
training procedures and the evaluation of new computer hardware and soft- 
ware systems. The interactive cotnputer system has graphic capabilities, 
allowihp, the student to "point" to stimuli, e.g., to syllabicate a word 
•shown on tha screen. More importantly for tlie low-literate training, 
the terminals are equipped with a Vortax voice synthesizer. This computer- 
generated speech capability permits a fully interactive and individualized 
training program with computer presentation in eitlier the auditory or visual 
mode or both. A programming lanp.uage incorporating the graphic and voice 
Rvntlieslzer ca^ki lit ies has recenX^y been generated and the courseware 
for tlie phonic skill training is nearlng completion. 

Tlie second experimental program Is being developed by Carver (1973a) 
imder the sponsorship of the Office of Naval Research. The training 
In this )»rogram, ratlier tlian focusing dlt specific reading skills, will 
Involve 130 liours of practice on the terminal objective — reading and 
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comprehending prose 'material. Prose passages will be presented over 
a PIJVTO computer terminal, thus permittirijyUndividualized instruction. 
The passar,es will be presented in a modifjB^d cloze format (Taylor, 1957) 
in which every fifth word ' is deleted and feh^ student makes^ in^ltiple 
choice selection to fill the blank. This procedure f orcesKontsiTiued 
atfcntion to the passage and provides constant monitoring of performance. 
The primary objective in Carver's work is to determine if there are two 
types of poor readers — thpse lacking the intellectual capacity and those 
lacking the. educational experience. The latter are expected to gain 
from reading training. Thus, students will be screened for intellectual 
ability using the Raven's Progressive Matrices and the high and low scorers 
will be compared. Those receiving training will consist of^^j^^ grade 
level readers. Piloting testing of this system has recenti^jf^I^egun. 

The final experimental program involves the evaluatioft of the 
Encyclopedia Brittanica program for functionally illiterate adults. 
The proj>ram is at a considerably lower level than the other programs 
ve have discussed and assumes no reading ability. Training is in pronun- 
ciation,* listening, and basic reading skills. This program has been 
instituted aboard three ships where participation is voluntary. The 
experimental evaluation of this program, by the Chief of Naval Education 
and Training Support, is just getting underway. 

Prediction of Training Success 

As a final topic in the review of the Navy's literacy research, 
I would like to present some of the results obtained in my own research 
efforts to cliaracterizt: the successful student in the NSD reading program. 
For the past several months we have been administering a battery of tests 
to all recruits entering the program and examining test scores in relation 
to the amount of gain in reading ability.^ Our first sample consisted 
of 111 recruits, 32 of whom had English as a second language. We then 
made some modifications In the test battery and have recently beg^in 
collecting data on a second f^ample. This sample, at present consists 
of 41 recruits, 21 of whom ha^e English as a second language. It should 
be borne in mind that the data I am presenting applies to the 1975 NSD 
program \^iich was described previously. Programs differing in instruc- 
tional strategies would likely produce different relevant variables. 

One of the first hypotheses we examined was that the reraediabili ty 
of poor readers Is dependent u^on their Intellectual ability. This is 
a basic hypothesis In Carver's (1971) experimental reading program dis- 
cussed previously. To test this hypothesis we used the pattern matching 
(PM) test (derived from the Raven's Standard Progressive Matrices as 
described previously) as a part of our battery. The split half reliability 
(corrected for attenuation) of the PM, based on the scores of 1200 recruits, 
Is .ft5. Our dependent variable was the gain In reading scores over the 
course of tlie reading program. If a student wais at;trited from the program 
lie was- p.iven a scorr of 2.6, .4 RCLs below the lowest exit score. Mean 
PM performance was consistent across the four groups (successive samples 



Analvsls involving post test scores have yielded comparable results. 



cr6Hsed with English as a 1st or 2nd language) ranging from 19.5 to 22.5 
(o « 4.9 to 6.6). This is , significantly below the mean of 28.3 obtained 
for all recruits at fhe San Diego boot camp. The m^an R^in in reading 
ranged from .8 to 1.8 RGLs but was not consistently related to a language 
group. The gains and the correlation of gain and PM performance is pre- 
sented In Table 8 for the English as a native landftage (E ^st) and English 
as a second language (E 2nd) groups. w 

. Table 8 

Mean (Standard Deviation) Reading Gains and the Correlation 
Of Gain With Predictor Variables for Native Language (E 1st) 
And English as a Second Language (C 2nd> Groups in Two Samples 









Correlation 


of Gain With: 


• 










Pattern 


Decoding* 


Mean 






Group 


(N) 


Matching 


Skill 


Gain 




Sample 1 


E Ist 


(79) 


-.02 


.AO 


.8 


CI. 7) 




E 2nd 


(32) 


.19 


,30 


1.8 

♦ 


(1.9) 


Sample 2 


E 1st 


(21) 


-.39 




1.23 


a.A9) 




E 2nd 


(29) 


.18 


.28 


1.0 


(1.1) 



Reading gain is calculated as the posttest-pretest difference on 
alternative forms of the vocabulary and ccjmprehension ^btests of the 
Gates-MacGinlt ie Reading Survey D. 



Thd correlation between PM and gain is low and not statistically 
significant (p > .05) across all four groups. If anything, there is a 
tendency toward a negative correlation between gain and pattern matching 
for the K 1st group. Thus intellectual ability of * low-literate recruits 
Is not predictive of their gain in this reading program. This result 
Is consistent with our finding with a random sample of all recruits, where 
it was found that PM was not strongly related to general reading ability 
(r - .A3). It seems that while intellectual ability is a ccmiponent of 
reading skill. It alone does not set the limits for the level of skill 
attained in a reading program, at least as found in our heterogeneous 
adult population. 

Our second hypothesis was that those students more proficient 
in decoding printed words into phonological units would show greater gains 
in reading. This is oftera reported by the instructor's in the reading 
program and, in the NSD pnogram, it is the ratHMlale for rejecting recruits 
below the 3.0 RGL. The word knowledge subtest of the Wide Range Achievement 
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Test, was Inc'tud^d ;m qut:.M The word knowledge 

tesll .Injrolve^^e presen^atl^on o»| gr^d^d" serle^. of printed words with 
tJ\e* jiubj«€t '^fta^ bel?a^ to aimj^y prgrtbui^j^ the Verds ' correctly . Cor- 
rectne^84fi*'jj5ronuncl^fi^ a t^at adnvwiitrator judgment and grading 

" respecV to<regia^l and e^thnJ/c dij^ferences in pronuncia- 
['•test does ho£ tak^ ^tnw" '^ccftjrU^ tfie student's knowledge of 
{nf^ot the wprds/^ , , ' > ^ 

_ Results ODOaoed wito* the* d-ecoding skill test supported the hypothe- 
sise Pe^ormance Thi this t^jret wajs consistently one of the best predictors 
* of gain-, with tfi^cSrrelat ion being somewhat higher for the E 1st sample 
(r - and .54)^hen f or /th^ 'EL. 2nd. sa^ (r - .28 and .30). As indicated 
by>^ the instructors, deci^l,qig skill, is an important determinant of ability 
tp iea^rn^to read in a shbr^i-diiration program. Decoding skill, however. 
Is cleaMy not the only factor. The mean decoding performance (JLn grade 
levels) for the F. 2nd samples was 10.1 as compared to a mean of 4.7 for 
the E Ist, a difference of 2 standard deviations. The magnitude of this 
difference was consistent across samples^ yet the gain in reading for 
the E 2nd group is not consistently greater than for the E 1st group. 
We feel tfiat a second major distinction between the language groups, which 
will account for differences in gains is semantic knowledge. The E 2nd 
consists primarily of Filipinos who have been taught decoding rules for 
English since grade 1. However, their experience with the language has 
been largely limited to schoolroom use. Thus, while they can readily 
decode the printed word, their semantic knbvledge 4.^ deficient relative 
to the E 1st and will affect their progress' in the"^ remedial program. 

We included reading and listening tests in our battery to test 
the above hypothesis as well as to test the hypothesis t^at a large' 
difference between reading and listening skills is predi^^e af the gains 
to be made in a remedial program. The tests were developed from the 
vocabulary subtest of the Nelson (1962) reading test. The odd numbered 
items on the test formed our reading test and the even test items formed 
the listening teist. Presentation of reading and listening items was alter- 
nated in blocks of 5. ''Listening** test is somewhat of a misnomer since 
both reading and listening items were presented via slides at a yi sec 
rate. For the listening items, however, the stimulus and alteri^tives 
were read to the subject while he viewed them. Split-half reliability 
of the listening test calculated on our first sample yielded jfj^ r 
(corrected for attenuation). 

Tlie mean Jlstcrrity; and reading performance for each language group 
Is presented in Table 9. The data indicate, as might be expected, that 
K \hI re( rults have a larger listening* tiian reading vocabulary. Their 
listening, skill is exercised constantly through interaction in an English 
language comaunity, while their reading skill training is likely to be 
limited tn use in tlie educational system. The H 2nd recruits, on the 
other hand, have equivalent reading and listeninp, vocabularies indicative 
of an exposure to Hnglish, spoken or written, which is limited to the 
classroom. The ^tata further indicated that the F. 2nd recruits have a 
vocabulary knowledge greater than the reading vocabulary but less tiian 
the listening votabulary of the E 1st. The F 2nd recruits, while being 
able to ilerode far more -words tlian the E 1st group, have more limited 
semantic knowledge nf those words. 
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Table 9 



Mean (Standard Deviation) Reading and Listening 
Ability Scores for NatJLve Langudgfe (E 1st) and English as a 
Second Language (E 2nd) Groups Collapsed Across Two Samples 

^ ' : 

Reading Llbtenlng 

^ ^.o 26.1 31,1 

(5.1) (5.0) 

^ 2nd ^ 29.7 28.0 

(5.0) (4.8) 



We have calculated the correla^tlons bet%reen reading and listening 
skills and gain scotes. However, the pattern of correlations Is ngt stabl 
or clearly Interpretable. Thus, I will delaty discussing that data until 
our second sample Is complete. We have Included a number of additional 
measures In our battery for the second sample. These Include some of 
the traditional measures of Navy efflctlveness, such as number of depen* 
dents and years of education, as well ma tests of Immediate memory and 
ability to maintain a high level of ^erform^ce at a tedious task. The 
Intent of these tasks Is to look for what may be general ability deficits 
In our lo^readlng ability recruits. r ^ 
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READABILITY RESEARCH IN THE* NAVY 



Thomas E, Curran * 

\ A great deal^of concern has recently been voiced with regard to the 
quality of instructional and maintenance itianuals in the NaVy. Men, both 
on the job and in the classroom, have tended W have problems using manuals 
• due to the difficulty of both text and graphics, inadequacies in content, 
lag time in updating, etc. The thrust of this paper is with the first of 
these deficiencies, but its concentration differs from that often found in 
work on readability. Readabilitjst per se , is not a difficult problem If 
one assumes as its operational definition a "readability formula score." 
As measured by readability formulas, almost anyone can write readably. One 
simply uses short words and short sentences. Given these^ the "readability" 
of the material .will be at a high ("easy") level when indexed by the most 
common formulas* Obviously, this is a simplistic view, particularly for 
technical writing. Technical writers (nearly all writer^spreparing Navy 
materials) cannot always obpy the dictum to use short worJsT What "easy" 
word can be substituted for "oscilloscope," for example? But even for 
these writers, readability need not be, a severe problem. One must merely 
idodify the above description to say "use familiar words and short sentences" 
and modify the readability assessment procedure so that long familiar words 
do not inflate the reading grade level (RGL) of the material. A major 
part of the R&D effort in the field of* readability should therefore be 
directed at identifying long words which are known to be familiar to the 
Intended audience and effectively transmitting this inforroatidn to the 
writer. This topic will be discussed in other contexts at a later point. 

There is a second characteristic of writing that deserves special 
attention — comprehensibility . There seems to be some misapprehension in 
the literature to the effect that hl^fi readability ensures comprehen- 
sibility. Only if readability is taken to Include good "style," smooth 
flow of ideas, avoidance of complex sentence structures, etc. Is this the 
case. Note that this represei^ a rather drastic departure from the 
operational definition of readability suggested above, and^ in fact, 
closely resembles the acceptedMef inition of comprehensibility > But 
the position is taken here that they are clearly two different concepts* 
At this point in time, readability formulas cannot adequately assess 
characteristics such as style and sentence structure.- It is true that 
readability and comprehensibility often go hand dn hand. The nursery 
rhyme "Mary Had A Little Lamb" is written at a very low level of difficulty, 
and because of the structure of its sentences, its simple words, and its 
easy flowing slP|rle is also quite pomprehensible. But examine the other 
extreme (unlikely as it would be coming from any rationale author) . If ' 
the words in the rhyme were "scrambled," with the length of sentences left** 
intact, its readability score according to formula would be identical to 
that of the original version. Yet its comprehensibility would be reduced 
enormously. In between these two extremes fall countless examples of writing 
Which vary along each of the two dimensions* In short, compreh^slbility , 
like readability, its a property of the written material, and when the work 
is done carefully the two are at least moderately correlated* But bear in 
mind that the former cannot be directly assessed by means of existing 
formulas. 
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^.'■^ further complicate the issuer there is really no point in speaking 

of either readability or comprehensibility unless the intended audience is 
taken into account. Tyo characteristics of the audience (other than 
general reading ability) are of prime Importance:* the background knowledge 
possessed and the degree of motivation involved. The adult reader faced 
with the scrambled version of "Mary Had A Little Lamb" might comprehend 
it reasonably well because of repeated exposure to it in the past, and 
might find it to be a stimulating (i.e., motivating) puzzle-solving ex- 
perience. The same strings of words seen by a child for the first time 
would probably be incomprehensible, even though the individual words them- 
selves could be decoded. ^^ - 

Lest one be misled by the above statements, it should be made clear 
that readability is NOT a trivial issue. It is a necessary , but not a 
sufficient condition for high-quality manuals. All other factors being 
equal COMPREHENSIBILITY requires high READABILITY, and one step r^oved, 
USABILITY requires high CCWPREHENSIBILITYw ^ If a manual is not readable, 
the student or technician will not even attempt to use it once he hy 
been stjnnied by its difficulty at the outset. He probably will avo« it 
from that time on, just as would anyone presented with a tome repliete 
with long words which he cannot decode. But to be readable is not enough. 
If the manual is not also comprehensible, the man possibly will not be 
able to use it despite his need for the information that it contains. And . 
the problem again is no;^ even that simple. Material can be virtually .un- 
readable according to a formula score and yet one who is vitally interested 
in the topic and/or needs the information regardless of the effort required 
. to obtain it may slave his way through it despite the writer's opposition. 

The interactions among readability, comprehenflibility^ and usability 
(all prppttties of the material ) and reading ability, comprehension ability, 
motivation, and background experience/knowledge (all properties of the user ) 
should provide the overall iQodel for any R&D effort in improving Navy 
manuals. * 

In the third quarter of Fiscal Year 1975, the Navy Personnel Research 
and Development Center (NAVPERSRANDCEN) was tasked to investigate the read- 
ability and comprehensibility of technical manuals (TMs) . An extensive 
survey of the literature was undertaken to determine the state-of-the-art 
in this area and report findings (Curran, 1975). The conclusions of this 
author were that the area of readability and comprehensibility has been 
covered in breadth but not in depth. A dilemma appears to have evolved. 
Formulas can be applied efficiently — autoraacion has become the rule—but 
it is possible that only judgments of the martial by readers can pro- 
^^^^d^ an index of Its comprehensibility. ^ ^ 

Prediction of Readability 

This author makes the same distinction between prediction of readability 
and production of readable writing as put forth by Klare (1975). This 
section deals with the first of these probf^ems while the following sec- 
tion deals with the latter and the interaction between the two. 
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* Readability Formulas: General 

■ ../ 

The most common method for predicting *he difficulty of a given 
piece of material is the readability "formula," A great miany of these 
have been developed, with the majority using as variables some index of 
sentence difficulty and individual word difficulty. Reviews of these 
formulas up to 1960 can be found in Klare (1963); Klare (1974-1975) 
reviews thpse. developed after 1960 and modifications to edrlier ones. 
Reference in this paper will be made to only five such formulas: the 
FOKCAST formula, the RIDE scale, the Fog Count, the Flesch Reading Ease 
(RE) formulas, and the Dale-Chall formula. 

Ip general, the prediction of readability by formula involves "counts 
of various components of vr i 1 1 eg ma t er ia 1 and, using passages of known 
difficu,lty as criteria, computjflPa regression equation on the counted 
characteristics. Conmonly, the^riterion passages are developed using the 
"cloze" technique. This procedure, which is of concern throughout this 
paper, involves extractftig verbatim passages from the material and deleting^ 
every nth word, replacing each with blanks of standard length. Normally, 
every 5th word is deleted, resulting. in five versions of the test for each 
passage (deletion of words 1, 6, 11, ... n, up to 5, 10, 15, n). Thus, 

each word in the passage is deleted once across the fiv||^versions. \ Subjects 
of known reading ability are asked to fill in as many ot the deleted words 
as they can, without having first read the intact passage. 3flM||ading 
level at which 50 percent of subjects can fill in approxiinat|^^Bp per- 
cent of the missing words is usually taken as the reading gveSltftkvel (RGL) 
of that passage. 1 This "scaled" RGL is then used as the criterion for 
regression of the counted variables. 

f V 

g As an example, Bormuth (1969) used this procedure fot deriving a 
number of readability formulas. He examined, in an extensive corAla- 
tional study, approximately 170 different variables, such as vocabulary, 
syntactic complexity, and parts of . speecA, and their relationship to the 
difficulty of written material. He first determined the correlation of 
each of these variables with the difficulty of 330 100-word passages as 
scaled with the cloze technique. He then entered the variables into a: 
regression equation to determine which of them in combination best pre- 
dicted the' difficulty of the passages. The outcome of this, study was a 
series of formulas, each designed for a different purpose, incorporating 
the "best" of the variables for predicting the difficulty of other writing. 



RGL is comgarable to, but not equivalent to,, school grade; it is a 
somewhat arbitrary level at which a particular grade ^student should be 
able to read with satisfactory comprehension. 40 percfe^ correct on 
the cloze test has been shown to be approximately equivalent to a 75 
percent score on a multiple choice test on the material.^ 
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The Flesch "Reading Ease" Formula 



Probably the most widely ysed (and most consistently powerful) of 
the readability formulas is that developed by Rudolf Flesch (1948). This 
formula^ termed the Reading Ease (RE) formuli—uses -as variables the 
number of words per sentence and the number of syllables per 100 words 
of text as its variables. The original RE formula is presented below: 

READING EASE = 206.835 

♦ - 1.015 (words/sentences) 

.846 (syllables/100 wofds) 

This formula was developed in much the same manner as described above, 
except that the criterion was set Df standardized passages rather than 
passages normed for the specific purpose by the. cloze technique. The 
formula indexe^i the difficulty of material on a scale from 0 ^ (practically 
unreadable) to 100 (extremely easy). Using this index, the RGL can be 
determined from a conversion table. The formufa was developed and 
validated on children and civilian adults, with reading material appro^ 
priate to these samples, and its usefulness for assessing the difficulty 
of military tec|||tcal or instructional writing is therefore suspect. Jn 
order to overcome this problem, Kiricaid, Fishburne, Rogels, and Chisson 
(1975) recalculated the formula using Navy enlisted personnel reading Navy 
Job-relevant literature.^ In the process of this recalculation the RE 
formula was also revised to produce RGL directly without having to take 
the extra' step of converting "reading ease" to RGL via a conversion table. 
The recalculated version of the RE formula is shown below; 

GRADE LEVEL = * .39 (words/sentences) f ^ 

'+ 11.80 (syllables/word) ^ 
- 15.59 ^ 

The R£ formula has the advantage of being relatively simple to compute 
manually and is adaptable to automation as well. Klare, Rowe, St. John, 
and Stolurow (1969), among others, have developed a computer program 
which provides the RB index based on the original Flesch formula. It 
remains a fairly simpl^e task to revise the program for the recalculated 
version of the formula. 

Application of the" RgadinR. Ease Formula j 

\ 

Based on the RE formula's consistent validity when compared with 
other forijulas and its relative ease of manual computation, the Chief df 
Nav^l Education and Training Support ''Readability Working Group" used the 
formula in an analysis of all Navy rate training manuals (RTMs) to deter- 
mine their difficulty. Biersner (19^5) reports on this effort*. He 



^These authors also recalculated two other formulas — the Automated 
Readability Index and the Fog Count — which will be addressed at a later 
point. 
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analyzed 185 Navy RTMs/ using ijoth the original Flesch formula and the 
. revision by Klncai< et al. (1^5). (As with Biersner, <thls formula will 
be referred to herein as the Kincaid i:ormula.) Biersner 's work illustrates 
vividly the Importance of the pr^iction/of readability in general and to 
the Navy^in particular. Bear in mind, .^hrdughout the discussion to 
follow, that RTMs are a major source of ^information required by Navy 
personnel for advancement in rate. Twetity-fiv6 samples were taken from 
each of these manuals, their difficulty was determined^^ and the average 
for the entire manual was computed. Considering only the KJLncaid formulav 
Cwhich i0 considered more appropriate for Navy yriting) , .the range of 
difficulty of the 185 RTMs was frc3m an RGL of '8.82 (for Basic Machines ) 
to one of^ 16.26 <for Disbursing Clerk 1 & C ) wXtH^ a median RGL. of about' 
12.6. That is to say 50 percent of the RTMs were written '^t , J? level of 
difficulty (as indexed by the formula) such that a "beginning college 
reading level" would be required to understand .Jdiem. , this should be 
interpreted with caution, however. There is %drorie-to-pne correspondence 
between the difficulty level indicated -by a awadability formula and the 
ability of a person to profit from-^the vrj^reen material. Biersner (1975) 
makes this point when he says, "The r«la^i<m8hip between RGLs (as deter- 
mined by any of the reading formulas which are ^)»llable) and reading 
comprehension or performance effectiveness i^ not well established, ¥ 
de3pl^ the importance of reading the development of most Other \ 
skil^P (p.' 7). ft may w^ll be tha\ the mere presence pf a Wavy recruit^ 
in the, naval mileau may be sufficient for him to comprehend .the nec^ssa^^jr 
elements of the RTM required for advancement. But thi» poJ.nt up thi 

issues raised in the introduction. A formula can i^dex £!he readability - 
bf^ material, but (at least as yet) no formula caij incfejp^its comprehensl^ 
bility . Jt is clear that the value of vriting can be atciirately deter- \ 
mined only froih within the framework of an overall model--the readability, 
and (he comprehensibility of the material and the state of the user In 
terms of motivation, background knowledge, and experience, etc. But at ^ it 
face value, assuming etll other factors to be equal, the comparisixi bety^en .^j'' 
the RGh of.<he manuals "as reported by Biersner and the reading abilities 
of recent Navy recruits (JHiffy & Nugent, Note 1) shqws a quite apparent , 
"man-manual mismatch." This comparison is presented 'in Figures ^and 2\ 
Figure 1 Indicates the full range of the RCL^ of the RTMs from the one * 
manual at the 8th grade RGL to those at the l4th and above. Reading 
abilities of recruits (as measured by t-he Gtttes-MacGlnitie te^^ &re shown / 
for the same intervals. The fact that ni» reading abilities are ^hown for ^ 
levels above 12th grade is an artifact, due simply to the fact tfiat the 
ceiling for this test is. at the 12,0 level^ Figure 2 presqits the same data 
In a different perspective. Here, readinj^abillties are Indicated by per- 
centages from grade 4.0 (and below^ to grade 11.0 (and above)* « All RTMs 
.whose difficulty exceeded 11.0 according to formula score are bulked 
int0 the latter , interv%3-* Noting the cumulative percentages Cilkaln at 
face value) it would be possible that approximately 24 percent of these 
recruits could read only one KTM~the single manual in ^hef sample betelk 
the 9.0 level. To interpretlKurther, approximately 82 percent of the^RTMs 
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|!r above; only 45 percent of 'the recruits 
^^1.0 level or above. And one further. 
Inot Indicated In the figures) deals with 
5. the manual Basic Military Requirements , The RGL of this manual is 10.85. 
'Knowledge of its contents are required for advancement to E"3 > Yet its : 
difficulty level is approxjbStlely. the^^iMje as the median read iii| level 
' of the over 21,000 recruits, poisMble that 50 percent of the entire 

. sample would not be able ^^Mw^ manual. Clearly, our ability to 
predict the difficulty leve]|^^.^j»ten materials is of immense Value. 
The data discussed above gi^^^BflPrery indication that certain RTMs 
shpuld probably be revised d^MRrd in difficulty level unless readlpg 
abilities can be Increased, » , 

^^^^^^^^ to. the striking findings reported above, another 
f^H^^HRft Biersner's work deserves mention. As noted earlier, the 
: ccwBjU jy Sn of the reading ease formula Involves a count of syllables, 
words*, rand sentences. While this cap be accomplished relatively simply 
Vlth nothing more than a paper and pencil, Biersner reports on a device 
wfllch greatly facilitated th# giant task of his analysis, Blex»ner directed 
the development of an electro-mechanical counting device vhict||^ would permit 
> more rapid and reliable gathering of [ the data. This device teok the form 
■ "■'j^ of a "stylus" jrtilch, when pressed to a surface, trips a micro«|iltch, which 
.V in t?im activates a counter, A relatively unskilled person usidg this devlc 
can/ therefore press the stylus to the working copy at the end of a syllable, 
y wdrd,. or sentence, and tha£ variable would be indexed by the counter, 
Biernser C1975) reports that "It made data collection over 30 percent 
faster, while maintaining high reliabilities" (p. 17), 
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Figure 1. Conparlson' of recruit reading ililltJes and training aaaual dlfficijity 
as reported by Biersner* ^ 
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Technical Terms and Measurement of Difficulty 

^ : [ — ^ / 

Ajnajor problem with most readabilitjr formulas (as alluded to above 
is that they were developed and validated using either school children 
or civilian adults. There is good reason to believe that the abilities 
of a child reading at the 6th grade level (for exampiLe) and of a Navy man 

^ also reading at the 6th grade level are quite different. Again, the 
« , military environqent itse!fe may be expected to account for perhapts great ^ 
differences in ttie words with which the person is familiar. This problem 
is even more acute when one is concerned with technical writing. Since 
word difficulty is usually Indexed in terms of the length of the word, 
the technical tej^s encountered on the job will ^end to inflate read- 
ability formulatlScores. Yet it is probably nonsense to assume that an 
electronic technician wou^ be unfamiliar with the word, "oscilloscope." 

♦ Traditional formulas have not addressed this problem directly,^ and ^et 
they must. It is arialagous to the ongoing theme of this paper. The fact 
that a readability formula indexes a piece of writing as "easy" or 
"difficult" does not ensure that it will appear t^t way to the intended 
user. Tw|^ questions seem to be at issue here: W what degree do technical 
terms inf^te the analysis (since they seldom exceed about 15 percent of 
the tota«ttimber of words), and, %f indeed they are a problem, by what 
means ca^the difficulty of techniaal writing b€ realistically indexed? 
The fArst of these question^ is a basic empirical one, 'and should be an- 
swered before proceeding with R&D involving the second question. Addi- 
tional formulas, and mqasurj^ent considerations not involving formulls, 
Ig^l be disQusse<i below^^t^ing these R&D priorities Into consideratloriiu 

' '^ ■ < ^ ■ 

The FORCAST ai^ RIPE \formu las M t ^ - • j| 

Cay lor, Stlcht, Fox,/and Forcf (1973) made an 'attempt to allay the 
problem of using formulas d^flved from' civilian samples in determining 



the difficulty of joftilitary wri^ng. fhey examined a total ofc J5 strg^ 
tural variables tn Army training lit|trature, including wordSwf*et senSnce, 
number of ihdepenc^t clauses, numbi^^iaf one-syllable words, and total^ ^/l 
<^ number of . syllables. Thiey Were also dissatisfied with the traditional 
jdability formulas for Use with military writing. They state: 

The fact that the formulas havegj^alldity coefficients*^ ^ 
of aUout .70 for predicting the p^Kormance of school ^ 
children on reading comprehension te||ts .indliDEi^es .that 
they account for roughly 50Z of the varlabilfty lii reading ' 
^ performance of children . It is l^lkely that they may 
account for less variabilify in adult per^rmance, , 
especially since material containing large numbers of 
technical terma Vould inc||||se the estimate of ^difficulty . 
»ma^e by the Readability fiora^^as. (jp. 6) ^ ^ 

^ Jhey thefefore examined job-relevant materials from j|^veA,ikilitary 
occupational specialities (MOfs^in tli! Army^ using scaled tGLa ^^^fiifi 
material (bashed on th% cloze tesi) as a critelPkon, and computed regression 



equations with the 15 variables. They Saund that the number of one- 
syllable words 'alone correlated «86 wlthr the criterion cloz@ scorap, and 
that^ the addition of either one or twoyadd It lonal variables to the equa- 
tion produced no significant Increase in this correlation. They there- 
fore Included only this varlAle — number of •ne-syllable words — In tfielr 
formula, which was termed "FORCAST." This formula became: $ 

FORCAST RGL = 20 - number of one-syllable words 

10 - . • 

* 

Based on their results, and considering ^^that this vehicle is* . ' 
probably the %ost' simple count to achieve reliably,^ the rationale for 
recommending the one-variable formula seems sound* It should be npted,' ^ 
4)owever, that others have found that the addition of a sentence-length 
li^afiable adds considerably to predictive power. Klncald et al. (1975), 5 
for example, found ,that^hb addition of a sentence difficulty facto;: to 
the word difficulty va«able Increased the "coefficient of determination" , 
•(indicating the d^grejr of shared variance between the prAifted grade ^ / 

level and ^(ponprehension of the/ test passage) from 41.6 percent to 57,2 ^ 
percent. thi.s is a sizable increase in power, indicating that the findings 
of Caylor et al. (1973) IP^ht be reexamined to determine If the difference . 
in power outweighs the ea^e^of computatiott» 



^ iparver (1973^1^) also developed a single-variable formula, ^ 
which he [ termed the ^^IDE scale (aftt acron^^f.or Reading ^npat-^'Blf f iciwt/ 
^ ^stim^^ scale). The variable used in gjPP formula is simply the average 

w number'^ letters' per word' (Ipw) in a passage. There are five levels which 

index RIDE difficulty: Levfel ,1 (up to 4.0 Iggw), Level 2 (4.1 to 4.5 
% Ipw); Level 3 (4.6 to 5.0 Ipw), Level 4 (5.^ to 5.5 Ipw), and Lev*l 5 

• (5.45 Ipv and alK)ve) . This' formula wottld appear to puffer from the same 

'"^ deficiency as the FORCAST ^^brfula. That Is, it considers on^u^ord dif- 
ficulty and Ignores santenee length. Further, it remains tflP^ seen how 
this formula ,wQUpld hold up with technical writing containing long but 
familiar terms, in view of -the factAhat'^lt was, valiaa;^fl|lif on the Miller- 
-* Coleman passage (Aquinp, 1969>«'UttJ|ng wihoai children. TJils <(uestion should 

J 'Jfce tesb|d to'jaetermiire/it^^alid^ " " I 

^ ^Carver based his wort* on tlw^. findings of Bormuth (1966, 1969), who 
showed that the nuvmllf^of^ letters |ier word wks 'One of tha hitgbest single 
correlates of the cloxe *difif icult:^^^ o^ 330 IQO-wayj^eak^jtasyages . 
' According to Bormuth (1969) only ,t|wg Dale "LongrlJit^'^ more 

' y .Aighl^ as a single vfir table thaiftlftumber of lett^^^^j^ }^ (and tlikt 
H'iv^ u ot|j^ ;j)66) . It should be natciff^ howeMpir , that both tHesii^>vai^iables*de^ 

owf^^ith w6jrd length/familiarityy a^d do not touch upon sent^ce dif f 1- $ 
^;^01t:y/: It has been shownsrconsist^tly that word length or familiarity ^ 
;?-:acjcbuhnts for a -gyeatair amount of li^lance than does sentence length. -If ^ ^^^fc^ 
' • SlnHr/s m^ goAlirUs to devise a pi;ediction ^formula containing only one 
vatiable, then ^tt^* fi^Mttj||^ would be sound. It sei 

worthwhile, hov^jenSc'io^ll^^ increase In predic- 

tive powcrr with the^^ajujiti^ o% a sentfn^jl^l^^l^uity ftetor. 
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Bojflauth (1969) did go beyond the examination of single variables 
In isolation. He conducted an extensive cort4lational study using approxi- 
mately 170 different variables, of which Ipw was dike. As a first step, 
he determined the correlation of each of these variajiles singly with the 
scaled difficulty level of passages as ref erred^^0Mbove, However, he 
then we^t on to determine, using multiple regresflfen" techniques, which 
of these variables in combiftation yielded the best predictive power. He 
arrived at four basic passage length formulas (each of which was computed 
against four different criteria). Two of these formulas (termed "un*||- 
stricted") employ large numbers of variables and are clearly unsuitable 
for other fchan very sophisticated automated computation, (Interestingly, 
neither of these basicV^ormulas includes Ipw as a variable.). To exemplify 
these formulas, an5l considering the fact that automation seems obvious 
to'become the rule for the ultimate analysis of difficulty, the "short form* 
of the unrestricted J^ormula will 'be described briefly; This formula 
consists of eight different variables plus the square of the two of these, 
totaling 10 entries in %e formula. The eight basic variables are (1) 
number of Dale Long List words, (2) letters per minimal punctuation unit 
(and its square), (3) number of /'referential repetition anaphora" (and 
its square), (4) number*of numerical jftouns, (5) number*f derived adjec- 
tives, (6) number o|f|lcommon nouns^ (7)' number of relative clauses, and 
(8) number of "class inclusive anaphora." It seems obvious that the pre- 
sent Qtate-of-the-art of readability analysis does not permit efficient 
application of such a complex formula. Its correlation with the mean cloze 
criterion (.874), however, is exceeded only tiVxhat of the even more com- 



plex basic unrestricted formula (.889). The^uestion rgnains (even dds-. 
regarding computer state-of-the-art) whether these ^"relations represent 
diminishing re^rns over the some%at^ower correlations ofr!(t*he much^mo^-e 
sii^le manual and mach^e computatioivRormulas dejBiprJ^bed below. 



Looking at the letters^ ^e^^^^ord variable alone arid comparing it 
to the two Bormuth ^mulas which include it and other variables, the 
results are aa folMRk: 0 ^ 

(1) >|sSfetters per word alone correlated -.721 with mean cloze scores. 
(For the purpose of this comparlj^^ only mean cloze score will be exami|ned«) 

(Z) tetters per word, when combined with letter^ per minimal ^ 
punctuation unit in the Itanual cointSutation formula, correlated .808 witjjpi ^ 
9ean cloze score (and .833 in cross-validation^) I > 

(3) Letters per worcl, when combined with number of Dale Long List 
words and words per sentence in Bormuth*s machine cothputation fgrmula, 
correlated .833 with the criterion (and . 920 in crosih^^^tdatibn) . 



^Crogs-iffelidatlon was Accomplished by applying*^ the formulas to 20 
passage* of 275-30© words, each taken fropi earlier work by Bormuth (196^.) 
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Disregarding the fact that each of the correlations increase^., in 
cross-validation, the addition of new variables, to the single' Ipw V-arir 
able resulted in an increase in observed (or shared) variance of from 
14-17 percent. It remains to be seen whether the additional difficulty 
and possible added unreliability in^^ounting letters per minimal punctua- 
tion unit or words on the Dale Long List would offset this rather sizable 
increase in predictive power. Carver reports correlations of .93 and -.94 
between the RIDE scale and the#Dale-Chall and Flesch formulas, respec- 
tively, using the Miller-Coleman passages as crilieria. He concludes *thc 
for these passages , /'there seems to be little difference between the pre 
dictive validity of Dale-Chall, Flesch, and RIDE" CCarver, 1974, p. 12) 
These discrepant findings — both of the other formulae consider setitence 
letigth and word difficulty or familiarity — remain to be . explained. 

The Fog Count o 

The Fog Qount ,>developed originally by McElroy (1953) for 'the Air 
Force, is perhaps the moit simple two-vari^le formula to compute manually. 
It involves siiroly a count of the number of^words of three or more syllables^ 
the total nnirfjijl H ^f words . and the number of sentences ^nd entering them 
into a simpl^^^^^mula. Rather than disCuss the original Fog Count it 
would seem mor^appropriate to address th^j "rep^lcxui^t^J^^^^ 
sented by Kincaid et al. .(ia75). Accord i'rt|5^c>iiit^ff^ 



version is "very similar" to' the original except that a dl£fM|«at sub^f ~^ 
tracted constant is used to ^feidress a problem of over^-estimatiBh en- ^ 
countered with the original. The Kincaid et al. 0-975) recalculation was ^ 
accomplil^hed using 569 Navy enlisted persc^nel reading material from Navy 
rate training raanuals^ at least 'BOine of which, was technical in nature, 
Itfi both the original^aiid the ^^leULpn, long fa^liarf terras are treated ^ 
specially ^ to avdd4^the;.problem o^f tl^Mr^ (Uftitrlfltlng erroneously to i;he 
difficulty of tlj^ jiaterial. For example, "General Eisenhower" Cconsisting 
of a total of sevA. syllables) is considered as one "easy" word for the 
purpose of calculating the Fog Count. , Other units, such as nixmbers and 
some abbreviations, are treated in a similar manner. IJ^ would' seem that., 
a similar procedure could be applied liri dealing with tefchni^al. terminology . 
known' to be familiar to the user of a given piece of material. ^Here a ' -> 
problem enters ^Bt is r€|||ated to the first of the bas^c 'questions posed 
above. Before the Fog Count (or^any other "fcrrmula) can be made tb^^k^ . I. . ^ 
account of such terms, the terms themselves mji^ be Identl 

sagy as one might first supptfSbif'^'in the #ield q< 



Th^ is not so easy as one might first suppQ*8t.f'v' In the #ield^ elec- \ 
, trpnics, for example, a basic di^ttonary of/terainology for comprehension ^ 
oL^written material could be obtained f rora. aji examl'nation of books in tke 
me^a. But to whom will this dictionirtfty .J^Iyt Will it be sufficient to 
4Kve only one such dictionary? If there Is' only one, will It atpply 
equally as well to the difficulty of material iealgned for basic elec- 
tronics training Ce^g.^. "A" school) aftd the senior^ petXy officen|.on the 
Job? ^0nsidering these questions, tl^ research involved would mem to 

- ^ . , % ^ . 

• . 

'^Carver poihtsy o^, feowever, on the basis of later work, that the 
Flesch andNj^aLe-i^ f^f^ to be ^'consistently^' betteir than otherC'!^4 . 



be a difficult, but not insurmountable effort. And once the dictionary (ies) 
Is (are) constructed, there is the question of whether the additional effort 
required in applying them is acco|npanied by a significant and practical 
gain in our ability to gear materials Xo the desired level of difficulty. 
With regard to the Fog Count, and preOTming that a dictionary of ^ technical 
terms proves worthwhile, the present advantage of easy manual calculation 
will probably reduced, the effective use of i dictionary of technical 
terms will virtually demand the aut^i^ation of the predictive device. The 
Fog Count in manual form, however, might even then be of value for a "rough" 
difficulty analysis where automation is not available. Reference to a 
"short list" of, say the 25 most common terms, could be accomplished during' 
a manual count, and such words treated as "easy" for the purpose of com'- 
putation. Further reference to this problem will be made with' regard to 
the Dale-Chall formula below and in the discussion of "production" of 
readable writing. ^ 

The Dale-Chall Formula * * '"''"^^-r:- 

The D^le-Chall formula (Dale & Chall, 1948) is a two-variable for^'.: 
muia which is based on average sentence length and the number of words in the 
jpassage not on the "Dale List of 3,000 "Easy Words," CThls "Dale List" was 
compiled by asking fourth graders which of a number of wor A they "kitew.") . 
To the best of this author's /knowledge, the Dale-Chall (D-C) formula *ias 
not been validated in a military setting. It is discussed^ere because^, 
it has consistently been found to be highly valid wtien comp%ed with other 
foopilas in non-military settings, ^and because it offers a "model" for 
construction of a technici|j|p dictionary or lookup list such as discussed 
_above. Again, presuming that the appropriate technical terms l^^ve been 



identified, such terms could possibly be simply added to the I^le List. 
Then, when encountered in text Csince they are on "the list"), they would 
be considered ^"^nown" or "easy" -and not contribute to the diffidiify indent 
of the passag^. If research indicates that a technical dictionary does , 
improve our prediction ability for military writing, the D-C would-be re- 
commended for use duetto its "track record" of validity. 



I 



Other Methods of Measuring Difficulty 



* The above discussion has considered only the prediction of read- 

ahn f|y hy basicaliy-ll&tatistlcal" methods.^ Mention Should also be made of 
two other, methods" f€)r*determining the readability ^and comprehenslbility of 
wril^en ma^erjUlj^^The first of the^ involves a judgment' of the quality 
oAjknterialll^p^PMs who read a passage and c^pare it to some stai\dard 
otfmo their oWtx Vxperie^rc^ of Job reading requirements. Carver (1974) ex- 
amined this procedure using his "Raudjjig Scale." A major advantage of this 
method over -that of formulas is t4iat style, sentence structure, etc.. can be 
assessed by t||^. readier,, a task which formulas ajj^e' un^le to carry o^£| 
In Carver's approach. Judges who qualify on the "Rauding Scale Quallfica-* 
tion Test" are asked^to judge sample passa^s and categoY'ize them according 
xo a set of six "anchor passages." Casing cne avefaj^Q^ rating of tluree i||ch 
'Judges, a^^ufide level for the Jtarget l^assage is detern^ified. In short. 
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Carver found the correlatlorys between Raudlng Scale judgment and the RIDE, 
Flesch, and D-C formulas to Vange from .74 to .84. These moderately 
high correlations indicate that human judges are taking into account 

#aracterj.stlcs of vriting similar to those used in calculating the for- 
la scores. It seems equally obvious, however, that human judges are 
considering "something else" la their ratings; what this might be one 
can only surmise/. Carver (1974) hypgt^i^firizes that the I?^uding Sc^e 
reflects "the difficulty of , thg, ideas be , concept s-in a passage," and 
liidlcate^Vwhen '^phopp and inappropriately inserted little Words" 

.^.jn^ke^i^^ understand (than a statistical estiute 

^Puokl4^^^^^ disadvantage of the use of human judges In 

;^t?lyf aL^sessment of readability and comprehensibility is simply availablLlty-r 
availability of time and of personnel. For such a procedure to be used 
effectively with the vast amount of j^material with which Wre Ijfavy is con- ^ •' 
f cerned would seem to be pl^ohibiti\^«in the extreme. ^ ^ . 

:p Another me^od for determining the quality of written material is 

the "cloze test" referred to above in the context of readability Criteria. 
There seems to considerable disagreement as to what the cloze test 
actually measures. Some say^it measures readability; others use the terms 
comprehensibility, comprehensloti, or understanding. Kincaid et al. (1975), . * 

for example, state that "subjects were tested^for their understanding of 
the selected passages using the cloze procedure""^ (jL 3, emphasis added). 
Sticht (1975) says "the cloze test provides a valid \measure of reading;' 
comprehension" (p. 20, emphasis added). A number on writers (Including 
Taylor, 1953, who developed the procedure)* refer tor the cloze technique ^ 
;4<as ,a -^measure of readability . \ 

If the operational def ignition of readability is taken to be the 
index provided by a readability formula, the cloze test will not con- 
sistently measure readability.* The results of a cloze test on the 
"scrambled" verslonr of •'Mary Had A Little Lamb" (for example) would 
probably bear little resemblance to the ^ow difficulty px:edicted by a 
formula.^ Clearly, X^ts is an extreme c«l. When writing of .f airlj^ high 
quality is examined there Is consistently a moderate to high correlation 
between cloze performance and readability as- predicted by formula. But * 
one would .expect, as the general "quality" of writing decreases, this -4.- 
correlation would correspondingly drop. It does no^piseem wise to use aa\,a 
measuring devica^ such a "rubber yardstick." * - ^ * 

V 'V ' ^ 

A correlation is also consistently 'f^ml^.betyeen cloze scores 
aiid "tomiii'ehenslon". or "understanding." It :^1^^iy well established •■ * 

^hat.^ «clQze;,^core o£ abo^^40-45 percent corresponds a comprehension Avi^' 
test score (after readinJ^Re naaterial) of about 75 percent. But again. It* ^T^- 
can bie shown thajt there afe limiting factorai "^is author has conducted 
a relat&^ely modest pilot study*'~tTv whidh cloze tests were adminlster|;d on j$ 
a single passage of about 2Cih h^j^^^ gnhjippfg were then asked to sj^jfgfifi,^^ 
precieely as possible what t^^^pa&^ageJwaa all about'. Only 3 subj^ts oiit: 





of the approximately 50 tested was able to provide eve1i a "reasonable" 
r approximation of the passage content. Yet the mean cloze scof>je ovei 'aBti: 
subjects was |fc)pr ox imately 40 percent This would seefn to be at leki£t^* 
an indication that the subjects were "comprehending" what they w^e 
reading. It is anticipated that a follow-up study will examine ^the dif- 
ferences in performance when (1) a title descriptive of the content of the 
passage is provided, and (2) a traditional test of comprehension is ad- ^ 
ministered following the cloze test. Again, since therjB a.re clearly 
limit's beyond which the' cloze-comprehension correlatiLon will not hold up, 
should we not b^ more precise in speaking about cloze ii^ general? 



^ . It is held .here tha] 
Siniiko, and Stolurow (1972 
measures the ^f^latlve compr 



n cloze measures compr ehens ib il i ty . Klare, 
!■ take a similar position wh^ they say "cloze 
jjhen^lbility or intelligibi!nty of written 



ai|||rlal." To reiterate an'^eatlier statement, readability and compre- 
liijlPlbility are not one and the same^ -Comprehensibility entails such 
factors as writing style, sentence structure, and expectancy for familiar 
words. The first two of these facit<?rs cannot be detected at all by 
availaj|^le readability formul^ The latter can be to some extent, 41- 
-thpugh the identil^ication oflRiose words which are familiar to a glveaa 
audience hars not yet been satisfactorily accomplished. Yet these factors ^ 
(and undoubtedly others, as well) are critical to performance on a cloze 
test. Multiple "(^bedding," for exaim}le, would, most likely cause cloze 
performance to deteriorate greatly, fonsider the following sentence: 

"This is the maMm^e rat the cat the dog Xea^d 
killed ate that iayWPthe house that Jack built." 

In this example — a syntactically correct ^sentence with a relatively 
low level of difficulty acfcording to formula — a person encountering it 
for the first time would'dikely have a very -difficult time with a cloze 
version. Style — that undef inable characteristic of writing — will cause ^ 
even greatjar problems. There seems to lie little doubt that, the smooth flow 
of ideas, with few deparjiures from the "standard sjrntax", enhances the prob- 
ability that the^^word which occurs to a reader fiot M Iglven "set" will be 
the correct one. In short, it is considered tha'b: ^t^'^i^p test should be 
considered a supplement to a readability ^^orjnulk/-\^g^^ that a^ passage'iVIk 
readable (as predicted by a fonijula), the^cloze performance of a set of 
subjects similar to the inteocfed audience of the passage should ensure thSt 
the material is also comprehensible.^ 

Assessing Job Reading Requirements ^ fP- 

••j/;. J . . ; ^J-i' ' ■ ' ^ 

Formulas/ judgments, and cloze scores all <rie¥rly play a role in 
determinirig the level of ability required by a user of written materials. 
They do not, howevfer , give an indication of the reading abrfity requtrcyd 
^ for ^a specific 1ob or even of the reading, required for that job. The Navy - 
Personnel Research and DevelDjjment Center (NAVPERSRANDCEN) and the Human 
Resources Research Organization (HumRRO) recently s^t tut to seek answers 
to these important questions. This research effort involves the direct^ 
wsessment:, of job incumbents' ability to read and understand job reading 
materials. It Invol^^es a structured interview of the job site in whj^ thit 
men are asked t^j^report whal^ specific reading Jthey^have undertaKeii/ln the ^ 
previous day or so that was dlrfctly connected with |;heir worft^:*-^jfhen a man 



reports th'at he used a specific portion of a specific publication to perform* 
Sa specific job, he Is asked tb. retrieve that same Information' lt\ the presence 
at the Interviewer. From this interview data, a Job Reading Task Test (JRTT) 
battery will be constructed, containing specific tasks requiring reading 
which it is known that job incumbents actually do. The^e tasks will be 
broken down into c^egories such as following- written dlifectlons, 'use of 
reference materialsyMdentifying main ideas, etc. The actual materials in 
each of these categories used an the job will be reprf|duced or used Intact 
in the JRTT battery. The battery vilT tljlen be normed.on a sample of recruit 
personnel of known reading ability btit not possessing job~specific skirls'^ 
and khowledg^es. Once the reading ability .required "for each of the tasks 
is determined, they will be submitted to job incumbenit^ for judgments of 
the crltlcallty of ea^ch .^nd the frequency with which ef&idli is performed. 
The • final prodiict wllJL^ he an inventory of various types' of tasks and the 
reading l^yel associated wl^hffv^ach. The ^Inventory can then he- used for 
geheral reading vrequireme^t^ for any tfavy training or job 
"In short, the inv^'tOEy will make- it possibljB to determine the 
-reading. tasks any rating, the crlticality of each, the frequency 
krt ^^l^.^pjgrfcfrmedi and ^n estAmate, of the reading ability required 
perform it. . 





ijlg^n be seen t^t in on^ sense, this is an airernatlve to the 
It^ifiJability formulas in-assessing the difficulty of material^ de- 
^^^yfe^-/4 specific ^ob. It has the advantage, however, af determining 
£ng abilities required for specific materials known to be used on 
Jb, whereas using formulas, some (or perhaps mttc'h) of tjhe material, 
ipled is not actually usei^ by job Incumbents (such fas "theory of opera- 
)n" for example). Put another way, the lac t that written material is 
"designed" for a particular job does not ne^ssarlly mean that it 1? 
required to perform that job. Needless to say, the JRTT method does not 
sujipl^nt ^e need for formulas, judgments, or cloze t^sts. "**%Jhen any new, \ 
matetiaj*^ rtS sent into the field, it is obviously necessary to ensure, as 
. far as. pose^ble, thA't the material will be satisfactory ^n^terms of read- 
ability and c'bmprehenslblllty. Whether it will be used , these tests, will 
not sayi The ultimate tests of its usability must come from the man on 
the job. . ' . ' . 

" ^. ■ 

In addi^tpn to providing Information as to the reading ability 
r0qulr«d to perform* particular jobs, it^ la^ hoped that information regarding 
"ireadership" will also etnerge; Thaf is, dofes i gap between reading ability 
andl difficulty of required jot reading intfterials influencie the extent to 
which men report usin^^ those materials. Jin discussing a similar ^ study 
for the Army; Stlcht (1975) reports that "the more able the reader, the 
'■^igreapel||ithe reported use of printed Materials" (p. 52) . 

Summary . . r » 

" V' " • , . ■ ' " ' * ■ ' 

Summarizing the^ra-rea of prediction of readability and Qompre- ^ 
henslbl^ty, it seemS^^^S^r that not just one, but a number oi^^approaches . , 
1 should be used to promote hligh quality Written materials. ReadabiliCy is V ^ 
a hMfsic characteristic and, ±rt its operational sense,, must be ^g^ssed ' 



according to a formula. But this Is not sufficient. The ccwnprenslblllty 
of ' the material must be assured means of cloze tests or human judg- 
ments. If. possible. Which formula should be used to predict readability, 
and which technlqueCs) should be used to assess comprehenslblllty are 
^stlll matters open to question. And finally, to ensure that Job reading 
materials are matched to reading abilities of job personnel, a technlqtoe / 
Such as the JRTT Inventory being developed by NAVPERSRANDCEN and HumRRO 
should be considered for Navy-wide use. " ' .J 

Production of Readable Writing . 

General 

Predicting the difficulty of written material "after the fact:" Is 
a major problem, but equally .or more Important Is the problem of producing 
"readable writing" In the first place. For this latter task there Is no 
"formula" which one .can directly apply. Writing Is an* ART as well as a 
SKILL. While It. Is probably impossible to tell someone how tp "do art" 
there shouldj^be some techniques by which the writer's skill can be en- 
hanced. This is the concern of this section, and in general, can be 
conceptualized as a three-part problem: f 

(1) Can a writing style guide be developed which will serve 
as a "job performance aid" for good writing? 

/* 

(2) Given that a writer is both skilled and artistic in his work, 
can^Mllitary Specifications be provided him so that his product conform? to 
our needs? ^ 

(3) How can we best provide the writer with "tools" to ensure ^ 

that specified standards Are being met? ( ' 

. Readability formulas play a part in the production process, out as - 
pointed out so clearly by Gunning (1968), "formulas are tools, not 
rules . . . warning systems, not formulas for writing." Pto^uction Is not 
simply the opposite side of the coin from prediction, although the* two pro- 
cesses are inextricably related. The two processes can be thought of as 
Iterative: one writes, then assesses the difficulty of the writing^ then 
rewrites, then reassesses, etc. The interaction between the two will be 
examined more thoroughly below in the contexts of specific writing aids. 

Research in the area of readable writing does give some cause for 
optimism, but for caution as well. There have been a fairly large number 
of studies which have shown clearly that experimental manipulation of 
writing variables can make a significant difference in comprebenslbility • 
In general, these experimenters (many of them conducting Ph.D disserta#lon 
research) have taken original passages and written easier and/or harder 
versions as indexed by readability formula scores. In examining these 
sources, the problem is one of specifying precisely what was changed to 
make the readability different. Most have reported that they modified word 
and sentence difficulty and little' else, presumably because these are the 
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two variables common to most readability formulas. Most vnrlters would 
argue, however, that such changed are either not sVff iclent or are too 
simple-minded for such* a complex task. It* is here\that a word of caution 
is in order. There sams to he little doubt that Mechanical shortening 
of words and sentences will do little, if anything^, other ^han laprorve* 
readability formula scores, with scant chance of improving the reader's 
comprehension. At the extr&ne, it is clear that a wtiter with ulterior 
motives could certainly produce writing that gets a better readability 
score and yet be less comprehensible than the original version. It s^sems 
clear, then, tha^J.n the research studies mentioned* above, the modifica- 
tion of surf ace ,'\rtRiables (i.e., word length, sentence length*, etc.) have 
incldentally^esulted also in changes to deeper (or causal) variables. 
This Is a* research question which is virtually untouched and yet which 
is critical to the undefrstanding of» how to make writing more compre- 
hensible. 

Style Guides ... • • 

The first facet of*, the problem o£ readable writing as mentioned 
above — style guides to aid the writer— would profit immensely from the 
research just suggested. The guidelines put forth by existing style 
manuals are based largely on intuition with little, if any, emi^irical 
base. It may be that such manuals ^re of no help to writers. They have 
existed in profusion in our libraries for years', and yet we are still 
suffering from inferior written materials. One ^st conclude from this 
that such guides are either not used by wrltetls of mjlitary materials or 
that the information they contain is inadequate to the task of telling "how 
to write." Information provided this authof by Dr. G. R. Kldre (personal 
communication) indicates pha^ the probliem lies, at least in part, with 
the latter of these possibilities. Klare reports that in reviewing 15 - 
source books (10 written specifically for ^technical writers) the agree- 
ment among authors as to specific suggestions was quite low. The sugges- 
tion "use short words" (for example) ,^ lihich one might expect all authors 
to agree upon, was mentioned in only two of the 15 books sampled. Out- 
right disagreement was found for such alternatives as Vbe jconeise" versus 
"he complete," and *'keep paragraphs short" versus 'Vary paragraph length." 
In view of this apparent uncertainty, among "experts" on writing. It is 
not surprising that much of bur material is unacceptably difficult. It 
is felt that progress is being made in this area* with' the publication of 
style guides specifically for the military writer. Under contract with 
the Naval Sea Systems Command, f 6r. es^ample, BioTechnology, Incprporated 
produced a guide titled "Requirements and Criteria for Improving Reading 
Comprehension of Technical Manuals" (Post & Price, 1974), T^Lls guide 
contains 17 ''tests" for Improving the quality of technical ihritlng in the 
three areas of Organization, Technical Communication, and Ileadabllity. 
The seven tests dealing specifically Jlth readability ani^comprehenslbility , 
in abbreviated form, are as follows:^ . ^ 

— ■ T- ' ' 

^This manual assumes that the writer is aiming at the ninth grade level; 
this should be considered in interpreting the tests ,^ An answer of "yes" 
to any question' indicates adequate readability (at ninth grade) on. that test. 



!• Heading Review ^ Do approximately one-half of the subparagraphs 
have headings? Is material' within paragraphs consistent with itis heading? 

2. Topic Sentence Check , Is the heading clear? Does the heading 
cover about three or four topic sentences or key points? 

3^ Words Per Paragraph Count , Do paragraphs average no more 
than 45 to 60 words? Are key points highlighted if the paragraph muat. 
be longer? 

C 

4. Words Per Sentence Count , Do the sentences average 20 words » 
or fewer? Have compound sentences and complex sentences been avoided? 

5. Syllables Per Word Count , Does the material average about 

1 1/2 syllables per word? Have short words been used whenever possible?^ ' 

6, Equipment Nomenclature Count , Is any unfamiliar nomenclature 
either defined in the tiext or called o^t onr an .accompanying pictorial? 

7, Layout^ Review , Has double-column format been used? la each 
graphip corptiguous with the text in which it is discussed or referenced? - 

• \ 

It is believed that ^this manual (which also contains specific 
guidelines for correcLing deficiencies, a large qumber of "rewrite <v 
practices," and geneuus illustrations of "good" and "bad" material) can be 
of valuable assistance to the technical writer. However, it> Is vital thftt 
it be experimentally tested Do verify this assumption. Work is currently ^ 
ijnderway which involves tHe^use of this guide in rewriting a technical 
manual and comparing the re\n:,itten version with the original in terms of 
its effectiveness. • * 

Military Speclficat tons" 

A second major area of concern in the production of readable writing 
is that of communicating the needs of the user to the technical writer. 
This is a quest^ion of the clarity^ conciseness, and completeness of 
Military Specifications (Mil-Specs) and Military Standards (Mil-Stds). ^ 
With regard to readability and comprehensibility, it is the opinion of this' 
writer that present Mil-Specs and*Mil-Stds offer little useful guidance for 
the writer. Othet" matters aside, it is clearly apparent that no test of . ^ 
Teadability or comprehensibility has been applied to these documents them- 
selves. One sentence picked more or less at random from <5ne basic Mil^Spec 
contained 47 words, of which 21 words were composed of three or more 
syllables. Other similar examples abound. But more specifically, with 

— : — ' >i ' — ■ 

^ ^The authors 6uggesQ that since manuals de^l with technical terms 
which cannot be eliminated^ these terms should not be included in the 
count of syllables. This procedlire should, however, ^e experimentally 
tested ' ' , ; ' ' . 



regard to specification of readability and comprehenslblllty standards, 
most or all such documents are woefully Inadequate. One, for example, 
states that "As a general guide, the level of writing should be for a 
high school graduate having specialized training as a techlcian In military 
training courses."^ Even those of us in the field of readability/compre- 
hensibility (much less the engineer/writer) don't really know what a typical 
high school graduate "looks like." And taken literally,, manuals written to 
this prescription (if it were possible) would automatically be excluded from 
use in at least some training courses, because the trainee would not yet 
have the "specialized training" required- to understand the manual. It 
would .be- comparable to the employment advertisements which specify "only 
experienced ^eed apply," when the "experience" can be gained only through 
the -employment. , 

Another, more basic Mil-Spec gives somewhat more explicit dir/c- 
tions. It .states: "Narrative text (thase pages that consist of not/less 
than ^00 words in consecutive sentences per page) shall conform to t^e 
following readability standards: The average sentence length (ASLy^shall 
not exceed 20 words . . . The average word length shall not exceed 1.60 
syllables . . . The 'percent personal sentences (PPS) shall not be less 
than 15 percent of the total.."^ The particular figures specified are 
reasonable; if such standards were achieved, the readability formula score 
would at approximately .the 9th or 10th, grade level. But, one might 
wonder if spme writers read any further than wher^ it says "... 200 
words in consecutive sentences . . .". Certa^ln persons responsible for 
pro4ucing technical manuals have been heard to say that "by definition" 
their writing never has more than 20»r wotos per page ±tt consecutive 
sentences; This is not to impty thac producers or writers of manuals 
intentidnally write poorly. Quite the comtrary, one suspects that they 
take pride in their work just as any professional does. But the fact re-- 
mains that much, of our technical writing is too difficult for many of the 
intended users. More specif Ic/guidancet and perhaps^ more rigid quality^ 
control, woul^ appear to be necessary conditions for rectifying this' 
problem. Arid accompanying such specif ications, it is felt that we must 
provide the writer with topis to meet oiir standards— the third general 
problem in the production of readable writing. 

Tools for Readable Writing 

What tools could we provide for writeps? In general the answer 
involves the various methods of assessing readability ^nd comprehenslblllty 
(Jlscussed in the previous section. As indicated earlier, prediction and 



^MIL-M-24100B, Manuals, Technical: Functionally Oriented Maintenance 
Manuals (FOMM) for Equipment and Systems, January 1974. 

^MlL-M-epOOOC tTM) , Manuals, Technical: General Requirements f^x 
Manuscripts, Decei|^er 
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production go hand In hand. 'Figure 3 Illustrates the iterative process 
that is involved. Included in this figure are some examples of the tools 
that might be provided the vnriter in order to produce an acceptable product. 
Basically, we see the writer producing his "first draft," relying at the 
outset primarily on intuitiodi in predicting its difficulty. At some point, 
however, a more precise assessment of the writing should take place. This 
might take the form of a readability formula (which the writer will be 
trained to use) computed manually. As pointed out earlier,, the formulas 
which are currently available from RIDE and FORCAST to the probably more 
precise Flesch (Kincaid) and Dale-Chall, are all relatively simple to 
calculate by hand. As our understanding of the problems specific to 
military writing (e.g., long,' but familiar technical terms) becom^ better 
understood, and as cost-effective and more efficient methods of analyzing 
readability and comprehensdibility are developed, it would seem appropriate 
to automate the process of prediction to the greatest possible extent* 
Several possibilities pr^ent themselves in this regard, ordered ±n . 
successively more sophisticated techniques. 

One such techi^que Is the Navy Automated Counter (NAC) developed 
for use in the CNETS .f^^ of Navy Rate Training Manuals (BTMs) (Biersner 

1975; Bunde, 1975). k^o reiterate briefly, this device is composed of a 
stylus which, when pfessed to a working surface, trips a microswitch, which 
in turn activates aj^punter. Used for counts of syllables, words, and 
sentences for the Fylesch and Kincaid formulas, it would be equally as 
useful for computing virtually any other formula. This could be a cost- 
effective aid whioh writers would probably find more acceptable than using 
simijly paper, pencil, and fingers. ^ This "acceptability" would probably , 
give greater assurance that accurate counts are in lact being made in the 
field. Bunde (1975), in a test of this device, found that it reduced 
the time to compute the Flesch formula by 46 percent over manual counts, 
with equivalent reliability, from the pcfint of view of this writer, such 
a device might be consdered*)as an interim technique. It is recommended, 
however, that more sophisticated procedures be planned for futxire use. 

At a somewhat higher level of sophistication are those readability 
analysis techniques which utilize a specially modified electric type- • 
writer. These are the Automated Readability Index (ARI) and the Reading 
Ease Assessment Hevice (READ). Given material to be analyzed diiring any 
typing stage 6t the pr6duction process, these devices (which are slmilaj; 
in design) allow the writer to determine tbe difficulty of his writing 
as it Is typed. Ess^entially , these devices take account of the number 
of "strokes" of, the machine to count the number of letters per_yord and 
the number of words per sentence to be entered into a modified Flesch RE 
formula. They both require typing skill, however, which may be a draw- 
back for some writers. In addition, their cost may be prohibitive Cfll- 
though not exorbitant) for situating at the many locales at which manuals 
are produced. If however, the cost is ^warranted, and if skilled personnel 
aire available for their use, ^hey represent a step advanced from the 
manual counting device discussed above. But in addition to the above 
factors, these devices are limited in that they provide only readability 
scores. As will be seen below. Improvement of technic^ writing overall 
actually demands much more. i ' 
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^ At. a higher level of potential, let us consider two possible 
systems— one marketed by Scientific T-ime-Shar^ng, Incorporated and the 
otlj|er developed at Harvard University^ ^ y , 

The first of these systems incorporates a modified < RE /:omputation, 
in wiiich a sample of material can, be input to' a computer terminal which Is 
connected via telephone line to a central computer. Material is typed 
at a remote terminal and, on signal, an almost instantaneous analysis of 
the writing is printed out. A seemingly. advantageous characteristit of 
this technique is its ability to reduce the impact of long technical ( 
terms on the analysis. When inputting the material, if a fiamiliar but , 
long technical term -is encountered, it is counted as any other word at / 
Ats first appearance—both as a discrete word and as a polysyllabic word. 
When subsequently encountered, it can be enclosed in brackets which ex-, 
eludes that occurrence from the overall analysis. The effectiveness' of 
this technique^ however, depends entirely on the ability of the typist to 
recognize rliose words which are of such interest and bracket them in an 
efficient manner. Unlike the ARI or READ devices, however, it is- con- 
sidered that the time-sharing system offers the potential for such 
features as storing of technical terms in a lexicon and future automatic 
exclusion of these terms from thfe analysis. It is considered that ^crCure 
R&D effort might well include the investigation of such potential. 

The secon(f of these computerized techniques is referred to as 
a £omputer Aided Revising, Editing, apd translating system (CARET I), 
and was developed by Klare et al. (1969). Like the time-sharing technique 
discussed above, CARET I also provides readability analyses after the 
material to be assessed has b^en input. It is felt that CARET I has at 
least twp distinct immediate ^g^vant^ges ov^r tha former system. First, 
it provides not one, but five s^drate analyses, includj.ng the Flesch, 
the Fog Index, and the Farr-Jenklps-P^erson revision of the Flesch 
formula. Secondly, it provides a tri^e-spaced printout of the Inputted 

'material, indicating for each word the number of syllables^ ,and for each 
sentence the number of words. The editor/writer can therefore' ad jiAt 
(as. necessary) word length and/or Sentence length,- enterling altema- ^x,^^ 
tives directly on the printout. And, like t^he time-sharing system, it 

• is interfaced with a large computer whicli would permit tie compilation 
of a lexicon and many other possibilities Eo assist, npt Ailx^J^ predic- 
tion oE difficultJTT^ut in writing and rewriting.^ Figure 3 shows how such 
a lexicon (as we]A as a Key-Word -irt-Con text file) might "feed back" into 
the various stages of writing. To exemplify the potential qf sych a . 
system, the entire text of (for example) an electronics manual coul<| be 
analyzed for thtf /frequency of occurrence of key words at the same time 
that tlie material^ is input for reajiabillty analyses,. Theif not only those 
words in the lay langjiage, b»ut also technical •terms, could be cataloged 

^N^bias in favor of these specific developers is intended. Other 
similar (and perhaps better) systems may well e^xlst and not* have come to 
the attention of this author. 
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according to their frequency and this Inf ormatlonSif d 'back^to writers 
for consideration either In rewriting or In original writing of new 
material in'jChe same sut>ject matter area. Optimally, It would' appear 
that the best features of both the preceding systems could be combined 
to form a procedure that Is efficient, effective, and co%t-benef Iclal. 



An, even more sophisticate system would be one' such as the Navy's 
technical Review and Update, of Manuals and Publications system (TRUMP) 
This system Is currently undergoing test and evaluation at the Navai Air 
Rework Fac lilt ty, Jacksonville, Florida.^ TRUMP Is technologically moi;e 
advanced than the others mentioned^ basically tecatise of Its Optical 
Character Recognition (OCR) and automatic photocomposition capabilities/^ 
This majfc^ It possible to eiectronjc'ally scan material to t)e Input, re- 
sulting In a reported throughput rate of potentially hundreds of times 
greatef than with .keypunching ."^ While no Readability analysis for TRUMP 
ha^ as yet been implemented, it would •seiOT'^'*© have the potential for 
virtually any such analysis as well as all other capaiilltles mentioned , 
is/connection with previous syst'ems. Of particular interest for Navy 
manuals, TRUMP can automatically ^roces^ illustrations and complex '*^ 
V tables as well as running text. Uppn ccinpletion ,of the ongoing T&E of 
TRUMP, it should be considered as a central feature of any future R&D 
effort in the rea of readabilitjl and comprehenslHllity^ 



Summary 



r 



The underlying theme of this paper has beAi'a plea for "^reformulation 
ofx the basic rationale underlying research in readability and comprehen- 
sibllity. It recommends that future research bt directed at determining ^ 
which of the many variables Involved in the readability and comprehen- 
slblllty area stand in causal relationships with the ability of persons 
to comprehend the written 'word. And finally it suggests that present 
^readability formulas^ with perhaps some n^dification, are acceptable 
when only readability Is being considered, but th^ a means must be ^ 
found to ensure that materials are also satisfactorily^ comprehensible . 
It seems that* the time has come to orient our efforts toward implementa- 
tlon of what is already known in the field, and to provide for the military 
writer the m^ans to achieve an acceptable product considered in terms of 
the needs of the user. « 
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